AI Terminology #16: Multi-Head Attention

• A mechanism within transformer models that allows the system to attend to different parts of the input simultaneously, capturing multiple relationships at once.

Try Command Code

The best coding agent for open models, in your terminal or on your desktop.

Desktop App · Docs · X · Discord