If you save optimizer as well then it will almost same (it is almot same because random functions e.g. dropout will have different value). If you does not save the optimizer, then it will use initial lr setting so it might results different.