Boolean Neural Networks and Anti-Noise Convolutional Techniques

The field of neural networks is moving towards more efficient and robust models, with a focus on Boolean neural networks and anti-noise convolutional techniques. Researchers are exploring new ways to improve the performance of binary neural networks, including the use of gate-level Boolean evolutionary geometric attention and dendritic convolution. These innovative approaches have shown promising results in image recognition tasks, particularly in noisy environments. The development of provably easy constructions of high-accuracy random binary neural networks is also a notable trend. Noteworthy papers include:

  • Gate-level boolean evolutionary geometric attention neural networks, which introduces a Boolean self-attention mechanism and achieves universal expressivity and hardware efficiency.
  • BD-Net, which proposes a 1.58-bit convolution to enhance expressiveness and a pre-BN residual connection to stabilize optimization.
  • Dendritic Convolution for Noise Image Recognition, which mitigates the influence of noise by focusing on the interaction of neighborhood information.
  • G-Net, which proposes a novel randomized algorithm for constructing binary neural networks with tunable accuracy.

Sources

Gate-level boolean evolutionary geometric attention neural networks

BD-Net: Has Depth-Wise Convolution Ever Been Applied in Binary Neural Networks?

Dendritic Convolution for Noise Image Recognition

G-Net: A Provably Easy Construction of High-Accuracy Random Binary Neural Networks

Built with on top of