A feed-forward neural network is said to be fully connected when
A) all nodes are connected to each other.
B) all nodes at the same layer are connected to each other.
C) all nodes at one layer are connected to the nodes in the next higher layer.
D) all hidden layer nodes are connected to all output layer nodes.

Question

Quizplus · Accepted Answer

In a fully connected feed-forward neural network, all nodes in one layer are connected to the nodes in the next higher layer. This means that each node in one layer is connected to every node in the next layer, which is why it is also called a dense network or fully connected layer. Options A and B, where all nodes are connected to each other, or all nodes in the same layer are connected to each other, respectively, are not true as it would result in very large networks with a large number of connections that might not be necessary. Option D is not true as it suggests that only the nodes in the hidden layer are connected to the output layer, whereas in a fully connected network, all nodes in one layer are connected to every node in the next layer.

A Feed-Forward Neural Network Is Said to Be Fully Connected