Start with a small model (maybe resnet18) and start experimenting. Often its more worth your time and effort to research tricks in how to train the model (e.g. learning rate schedulers) or inprove the data quality.