AI System Architecture Research Scientist Intern at Samsung · LumiJobs

Responsibilities

The Architecture Research Lab (ARL) is tackling two of the biggest challenges in AI today—memory bandwidth and communication bottlenecks. By leveraging Samsung’s world-leading memory technologies, we are developing next-generation AI systems that break through these limitations while improving developer productivity.
This internship explores how memory systems should evolve for agentic AI. AI agents work over long horizons, across many turns, and build up context faster than memory capacity and bandwidth grow. As a result, their accuracy and speed decline. You will research memory architectures and system optimizations that keep long-horizon inference accurate and efficient, evaluate them with performance models and accuracy studies, and turn the results into publications and into requirements for future memory products.
Location: Daily onsite presence at our San Jose headquarters in alignment with our Flexible Work policy
Reports to: Principal Engineer
Characterize LLM and agentic inference workloads (multi-turn sessions, long and growing context, reuse across requests) and derive their memory capacity, bandwidth and latency requirements.
Research memory hierarchies for AI inference that combine HBM, near-memory compute, emerging tiers such as High Bandwidth Flash, and host or CXL memory, including how model weights and KV cache are placed, moved, reused and compressed across them.
Propose new architectures and system optimizations, from hardware features to runtime and memory-management policies, that keep long-horizon agents accurate within memory limits.
Build and extend performance models and simulators, and run design-space explorations of different throughput, capacity and cost metrics.
Measure the accuracy impact of memory optimizations on long-context and agentic benchmarks with open models.
Drive the research from problem definition to results, working closely with architects, memory technologists and system-software researchers.
Publish results at top-tier venues, contribute invention disclosures, and help turn research into product directions.
Complete other responsibilities as assigned.

AI System Architecture Research Scientist Intern

Responsibilities

Benefits

Company

Samsung

More roles at Samsung