transformer/multi_head_attention library
Classes
- MultiHeadAttention
- Combines multiple self-attention heads to run in parallel.
- dart_torch package
- documentation
- transformer/multi_head_attention.dart
dart_torch package
- Libraries
- auto_diff
- dart_torch
- examples/nlp
- examples/tests
- face_net/example_face_detection_recognition
- face_net/object_detection_head
- face_net/object_detector
- loader/mnist/classifier
- loader/mnist/mlp
- loader/mnist/sigmoid_mlp
- loader/mnist/x_entropy
- loader/mnist_data_loader
- nn
- nn/conv2d
- nn/conv3d
- nn/examples/cross_entropy_loss
- nn/examples/encoder_test
- nn/examples/nlp
- nn/examples/relu_test
- nn/examples/relu_test2
- nn/examples/sigmoid_test
- nn/examples/sigmoid_test2
- nn/examples/sigmoid_test3
- nn/examples/softmax_test
- nn/flatten
- nn/layer
- nn/matrix2d
- nn/module
- nn/neuron
- nn/neuron2
- nn/nn
- nn/pooling2d
- nn/rnn
- nn/value
- nn/value_vector
- nn2
- nnue/eval
- nnue/nnue
- nnue/nnue2
- search/alphabeta
- swin/example_swin_transformer
- swin/patch_embedding
- swin/patch_merging
- swin/swin_stage
- swin/swin_transformer
- swin/swin_transformer_block
- swin/window_attention
- transformer/cross_attention
- transformer/encoder_decoder_transformer
- transformer/encoder_example
- transformer/example
- transformer/example2
- transformer/example3
- transformer/example_encoder_decoder
- transformer/example_gpt_generation
- transformer/example_gpt_training
- transformer/example_gpt_training2
- transformer/feed_forward
- transformer/layer_norm
- transformer/layer_norm2
- transformer/multi_head_attention
- transformer/multi_head_cross_attention
- transformer/network_utils
- transformer/self_attention
- transformer/test_save_load
- transformer/transformer
- transformer/transformer_block
- transformer/transformer_decoder
- transformer/transformer_decoder_block
- transformer/transformer_encoder
- transformer/transformer_encoder2
- transformer/transformer_encoder_block
- transformer/value_matrix
- transformer_misc/audio_transformer
- transformer_misc/chess_transformer
- transformer_misc/example_audio_video
- transformer_misc/example_chess_rl
- transformer_misc/video_transformer
- value
- value2
- vit/example_bipartide_matching
- vit/example_bipartite_matching
- vit/example_object_detection
- vit/example_object_detection2
- vit/example_vit
- vit/object_detection_head
- vit/object_detection_head2
- vit/object_detector
- vit/object_detector2
- vit/vision_transformer
- vit/vit_backbone