Attention Residuals: A Comprehensive Understanding
This paper addresses a fundamental problem in training deep transformer models: uncontrolled hidden-state magnitude growth as model depth increases. The auth...
Hey there! I’m Renee Jia, an AI Research Engineer working on Large Language Models and Large-Scale User Sequence Modeling.

I’m passionate about AI research and work on:
I love exploring how AI can understand and model human behavior through massive amounts of data. There’s something incredibly exciting about building models that can learn complex patterns and make sense of user sequences.
Previously worked at Google and Amazon Alexa AI on natural language understanding and recommendation systems. It’s been quite a journey seeing how AI has evolved over the years!
When I’m not thinking about AI models, you might find me:
In this blog, you’ll find:
Always excited to chat about AI research and share ideas! Feel free to reach out.
This paper addresses a fundamental problem in training deep transformer models: uncontrolled hidden-state magnitude growth as model depth increases. The auth...
Browser agents are getting better fast, but the web is full of things that try to steer behavior. If that already works on humans, why would agents be immune?
How ads ranking systems went from aggregated feature counts to retrieve-and-compress architectures that handle 10,000+ user events under millisecond latency ...
From specification gaming in classical RL to deceptive alignment and jailbreaks in LLMs—a survey of how reward hacking has become a central challenge in AI s...
Reasoning in Large Language Models: A Research-Centric Overview
A comprehensive guide to sequence-based recommendation techniques and key research papers, tracing the evolution from early statistical methods to modern tra...
Contemporary RecSys: Industry-Scale Architectures & Multimodal Systems (2020–2025)
Explore how deep learning transformed ranking and recommendation systems, from Wide & Deep to BERT4Rec, covering core technologies powering platforms lik...
Classic Foundational Papers on Ranking & Recommendation Systems
AI Beginner’s Guide: Learning Artificial Intelligence from Scratch
Welcome to My Blog