Fernando Velasco
Blog - long-context
    HELMET: A Fresh Look at Context-Length Evaluation in LLMs

    HELMET: A Fresh Look at Context-Length Evaluation in LLMs

    A benchmark system for evaluating LLMs across long contexts — summarization, long-doc QA, RAG, re-ranking, and generation with citations — beyond synthetic needle-in-a-haystack tests.

    llms long-context evaluation
    Titans: Neural Long-Term Memory for Enhanced Sequence Modeling

    Titans: Neural Long-Term Memory for Enhanced Sequence Modeling

    A paper that proposes test-time learnable long-term memory for LLMs, with a 'Surprise' metric that decides what in the context is worth remembering.

    llms long-context architecture
© 2026 Fernando Velasco Lozano
Built with Astro · Astrofy template · source
FV
Fernando Velasco
Senior Applied Data Scientist & AI Tech Lead
  • Home
  • Projects
  • Writing
  • CV
  • Contact