# data[].attributes.attachment_link.description
Get access to files anywhere through secure cloud storage and file backup for your photos, videos, files and more with Google Drive.

# data[].attributes.attachment_link.title
Notion - The all-in-one workspace for your notes, tasks, wikis, and databases.

# data[].attributes.attachment_link.description
A new tool that blends your everyday work apps into one. It's the all-in-one workspace for you and your team

# data[].attributes.attachment_link.description
Gmail is email that's intuitive, efficient, and useful. 15 GB of storage, less spam, and mobile access.

# data[].attributes.attachment_link.title
Portal Séneca - Consejería de Desarrollo Educativo y Formación Profesional

# data[].attributes.attachment_link.description
Portal Séneca - Consejería de Desarrollo Educativo y Formación Profesional

# data[].attributes.attachment_link.description
Access Google Calendar with a Google account (for personal use) or Google Workspace account (for business use).

# data[].attributes.attachment_link.description
ChatGPT helps you get answers, find inspiration, and be more productive.

# data[].attributes.attachment_link.readable_text
Mistral AI team is proud to release Mistral 7B, the most powerful language model for its size to date.

Mistral 7B in short

Mistral 7B is a 7.3B parameter model that:

Outperforms Llama 2 13B on all benchmarks

Outperforms Llama 1 34B on many benchmarks

Approaches CodeLlama 7B performance on code, while remaining good at English tasks

Uses Grouped-query attention (GQA) for faster inference

Uses Sliding Window Attention (SWA) to handle longer sequences at smaller cost

We're releasing Mistral 7B under the Apache 2.0 license, it can be used without restrictions.

Mistral 7B is easy to fine-tune on any task. As a demonstration, we're providing a model fine-tuned for chat, which outperforms Llama 2 13B chat.

Performance in details

We compared Mistral 7B to the Llama 2 family, and re-run all model evaluations ourselves for fair comparison.

Performance of Mistral 7B and different Llama models on a wide range of benchmarks. For all metrics, all models were re-evaluated with our evaluation pipeline for accurate comparison. Mistral 7B significantly outperforms Llama 2 13B on all metrics, and is on par with Llama 34B (since Llama 2 34B was not released, we report results on Llama 34B). It is also vastly superior in code and reasoning benchmarks.

The benchmarks are categorized by their themes:

Commonsense Reasoning: 0-shot average of Hellaswag, Winogrande, PIQA, SIQA, OpenbookQA, ARC-Easy, ARC-Challenge, and CommonsenseQA.

World Knowledge: 5-shot average of NaturalQuestions and TriviaQA.

Reading Comprehension: 0-shot average of BoolQ and QuAC.

Math: Average of 8-shot GSM8K with maj@8 and 4-shot MATH with maj@4

Code: Average of 0-shot Humaneval and 3-shot MBPP

Popular aggregated results: 5-shot MMLU, 3-shot BBH, and 3-5-shot AGI Eval (English multiple-choice questions only)

An interesting metric to compare how models fare in the cost/performance plane is to compute "equivalent model sizes". On reasoning, comprehension and STEM reasoning (MMLU), Mistral 7B performs equivalently to a Llama 2 that would be more than 3x its size. This is as much saved in memory and gained in throughput. Results on MMLU, Commonsense Reasoning, World Knowledge and Reading comprehension for Mistral 7B and Llama 2 (7B/13/70B). Mistral 7B largely outperforms Llama 2 13B on all evaluations, except on knowledge benchmarks, where it is on par (this is likely due to its limited parameter count, which restricts the amount of knowledge it can compress).

Note: Important differences between our evaluation and the LLaMA2 paper's:

For MBPP, we use the hand-verified subset

For TriviaQA, we do not provide Wikipedia contexts

Flash and Furious: Attention drift

Mistral 7B uses a sliding window attention (SWA) mechanism ( Child et al., Beltagy et al.), in which each layer attends to the previous 4,096 hidden states. The main improvement, and reason for which this was initially investigated, is a linear compute cost of O(sliding_window.seq_len). In practice, changes made to FlashAttention and xFormers yield a 2x speed improvement for sequence length of 16k with a window of 4k. A huge thanks to Tri Dao and Daniel Haziza for helping include these changes on a tight schedule.

Sliding window attention exploits the stacked layers of a transformer to attend in the past beyond the window size: A token i at layer k attends to tokens [i-sliding_window, i] at layer k-1. These tokens attended to tokens [i-2*sliding_window, i]. Higher layers have access to information further in the past than what the attention patterns seems to entail.

Finally, a fixed attention span means we can limit our cache to a size of sliding_window tokens, using rotating buffers (read more in our reference implementation repo). This saves half of the cache memory for inference on sequence length of 8192, without impacting model quality.

Fine-tuning Mistral 7B for chat

To show the generalization capabilities of Mistral 7B, we fine-tuned it on instruction datasets publicly available on HuggingFace. No tricks, no proprietary data. The resulting model, Mistral 7B Instruct, outperforms all 7B models on MT-Bench, and is comparable to 13B chat models.

The Mistral 7B Instruct model is a quick demonstration that the base model can be easily fine-tuned to achieve compelling performance. It does not have any moderation mechanism. We're looking forward to engaging with the community on ways to make the model finely respect guardrails, allowing for deployment in environments requiring moderated outputs.

Acknowledgements

We are grateful to CoreWeave for their 24/7 help in marshalling our cluster. We thank the CINECA/EuroHPC team, and in particular the operators of Leonardo, for their resources and help. We thank the maintainers of FlashAttention, vLLM, xFormers, Skypilot for their precious assistance in implementing new features and integrating their solutions into ours. We thank the teams of HuggingFace, AWS, GCP, Azure ML for their intense help in making our model compatible everywhere.

# data[].attributes.attachment_link.title
‎Gemini - chat to supercharge your ideas

# data[].attributes.attachment_link.description
Bard is now Gemini. Get help with writing, planning, learning, and more from Google AI.

# data[].attributes.attachment_link.title
MagicSchool.ai - AI for teachers - lesson planning and more!

# data[].attributes.attachment_link.description
Join over a million teachers saving hours of time using the #1 AI Platform for Education, MagicSchool, to help lesson plan, differentiate, write assessments, write IEPs, communicate clearly, and more!

# data[].attributes.attachment_link.readable_text
Para poder usar correctamente la aplicación del Portal del Personal Docente, la configuración del explorador que está usando debe permitir la ejecución de scripts. Para obtener información sobre cómo permitir scripts, consulte la Ayuda del explorador. Si el explorador no admite scripts, pruebe a usar otro explorador de Internet.

# data[].attributes.attachment_link.description
Para poder usar correctamente la aplicación del Portal del Personal Docente, la configuración del explorador que está usando debe permitir la ejecución de scripts. Para obtener información sobre cómo permitir scripts, consulte la Ayuda del explorador. Si el explorador no admite scripts, pruebe a usar otro explorador de Internet.

# data[].attributes.attachment_link.title
Aula Virtual de Formación del Profesorado. Junta de Andalucía.: Log in to the site

# data[].attributes.attachment_link.description
Todos los libros gratuitos y actividades de economía de secundaria y bachillerato. Algunos consejos para las oposiciones de secundaria de 2023

# data[].attributes.attachment_link.readable_text
Economía de la empresa en segundo de bachillerato con una carga lectiva de 4 horas semanales donde se van a analizar los distintos departamentos de una empresa, así como las decisiones que el empresario debe tomar.

Destacará un apartado para la preparación de la prueba de acceso a la universidad (PEVAU).

Economía de primero de Bachillerato con una carga lectiva de 4 horas semanales donde se va a dar una introducción de Microeconomía, Macroeconomía , Política económica y Comercio internacional analizar los distintos departamentos de una empresa.

Economía de cuarto de ESO con una carga lectiva de 3 horas semanales donde se van a dar conceptos básicos relacionados con la economía, la empresa y la educación financiera.

Fundamentos de Administración y Gestión de segundo de bachillerato con una carga lectiva de 4 horas, donde se llevará a cabo un proyecto de empresa completo.

Además el departamento tiene Iniciativas Emprendedoras de primer ciclo y otras optativas como en Andalucía: Economía Aplicada y Finanzas y Economía .

Oratoria y debate de 2º ESO, es una libre configuración autonómica, su principal objetivo es mejorar la expresión oral del alumnado e introducirlos en los debates académicos

Introducción al Pensamiento Crítico y Debate de 4º ESO, es una materia de diseño propio en mi centro, en ella se enseña a los alumnos a investigar de forma holística sobre un tema teniendo que defender las dos posturas de un debate

Además puedes seguirme y contactar conmigo en las redes sociales

# data[].attributes.attachment_link.title
Página elaborada por Inmaculada Lucia, profesora de Economía en secundaria y bachillerato. En esta página encontrarás ayuda para preparar con éxito las asignaturas de Economía o si eres profesor recursos interesantes para preparar tus clases.ECONOMÍA CON INMA

# data[].attributes.attachment_link.description
Página de ayuda para los estudiantes de Economía de instituto con muchas actividades, explicaciones, documentos y vídeos.

# data[].attributes.attachment_link.description
El Plan de Educación Financiera es una iniciativa de la Comisión Nacional del Mercado de Valores (CNMV), el Banco de España y el Ministerio de Asuntos Económicos y Transformación Digital. Tiene como objetivo mejorar la cultura financiera de los ciudadanos, dotándoles de los conocimientos básicos y las herramientas necesarias para que manejen sus finanzas de forma responsable e informada.

# data[].attributes.attachment_link.title
CNMV - Comisión Nacional del Mercado de Valores

# data[].attributes.attachment_link.description
Body in charge of supervising and inspecting the Spanish securities markets and the activity of all those involved in them

# data[].attributes.attachment_link.readable_text
Nuestro principal objetivo es fomentar la cultura y distribuir las grandes obras clásicas de la humanidad de una manera visual, ordenada y sencilla.

Creemos firmemente que la cultura debe estar al alcance de todo el mundo. Por ello, todos los libros son gratuitos y se pueden descargar de forma fácil y sin registrarse.

# data[].attributes.attachment_link.description
Elejandría es un portal web para descargar libros gratis en PDF, EPUB y MOBI de forma legal. Todos nuestros libros están en domino público o con licencias abiertas.