Viewing a single comment thread. View all comments

abystoma t1_iqrtynd wrote

Reply to comment by McMa in [D] Hidden unit connected to each other in a single layer by [deleted]

Thanks for your response. What exactly do you mean by virtual hidden layer, is this a layer for just initializing the input in the hidden layer and that layer is not used again, something like that?

1

McMa t1_iqtcdfp wrote

Just a normal hidden layer. The connection between nodes of the same layer in your schema can be thought of as two layers where each node forwards it’s exact value to the corresponding node of the next layer (weight frozen to 1), and the rest of the weights get trained.

1