There’s several strategies to combine multimodal data. Here’s some simple approaches:

1. First train the cnn classsifer. Then use it as a feature extractor by extracting the feature vector from the penultimate layer. Then augment those image features with the features from your tabular data. And then train it all with a classifier like xgboost.

2. If you want to train both your feature extractor and classifier end to end, you could try different strategies for encoding the tabular data into the input tensor. A simple and fun way to try is to encode them visually into your images themselves, such as adding a few more pixel rows at bottom of image. One row can represent country (uniquely color by a country index), and so on.

May use embedding for categorical value and linear for continuous value. You can also use bin for making continuous value into categorical.

Depends on how sophisticated model would you like to build, but the simplest way would be to flatten those data and add (extend 1D array) to flattened CNN part prior to last fully connected layers of CNN model.

Thanks that makes sense

Thanks , great ideas. I’ll try them

Your welcome. Would be great if you could update this thread after your experiment to see what worked best, to help future readers in the same boat.