Live intelligence

Latest AI updates

2 updates
Research Editor selected

RecoGEM: A Serving System for Production-Scale Generative Recommendation

RecoGEM is a production serving system for generative recommendation, where item identifiers are generated autoregressively instead of scoring candidate items. It uses a runtime-engine decoupling architecture to handle GR-specific responsibilities such as candidate-state transitions and live artifact updates, while the execution engine optimizes self-attention, candidate selection, and execution planning for short decoding sequences and large candidate populations. The system has been deployed for over nine months across production lines serving hundreds of millions of users and more than ten GR model families. On OneModel workloads, it reports over 1,000 QPS per serving instance, P99 latency below 35 ms, and a 2.88x throughput improvement over representative baselines.

Why it matters: It offers concrete architecture and production performance details for serving generative recommendation models at industrial scale.

Generative recommendationModel servingRecommender systems
Research Editor selected

Grading the Unannotated: WorkRB Skill Extraction Challenge at RecSys-HR 2026

The WorkRB Challenge at RecSys-HR 2026 replaces binary skill extraction evaluation with graded relevance (0-4) using nDCG@100, addressing the limitations of binary labels at ESCO scale. The paper details a cascade of four binary questions answered by a smaller LLM judge, validated via blind human and frontier-model re-annotation, and presents five benchmark datasets. Submissions converged on multi-stage retrieve-and-rerank pipelines, with gains from filtering nonsense rather than finding more positives, and graded evaluation reveals larger gaps between top systems and baselines than binary evaluation.

Why it matters: Provides concrete methodology and benchmark insights for graded skill extraction, highlighting a shift in evaluation that exposes model limitations and open challenges.

skill extractionevaluation methodologyLLM-based annotation