DataSci Ocean
Posts Tags Categories
English
DataSci Ocean
PostsTagsCategories
English
Home avatar

Apple Podcasts
Featured image for Cerebras's Enterprise RAG: Narrow-Waist Design, Decoupled Retrieval

Cerebras's Enterprise RAG: Narrow-Waist Design, Decoupled Retrieval

Hong-Wei Wu avatarHong-Wei Wu  published on 2026-07-23 included in  category Paper Introduction
How Cerebras's enterprise RAG uses narrow-waist design to decouple ingestion from retrieval, fuses rankings with RRF, and why it's a pipeline, not an agentic loop.
Read more...
 Large Language Model, Retrieval-Augmented Generation
Featured image for Adaptive Chunking: A Smarter, Per-Document Way to Split Text for RAG

Adaptive Chunking: A Smarter, Per-Document Way to Split Text for RAG

Hong-Wei Wu avatarHong-Wei Wu  published on 2026-07-22 included in  category Paper Introduction
One-size-fits-all text splitting quietly wrecks RAG pipelines. See how Adaptive Chunking scores candidate splits with five metrics and keeps the best per document.
Read more...
 Large Language Model, Retrieval-Augmented Generation, Evaluation
Featured image for SkillOpt: Treating an Agent's Skill File as a Trainable Weight

SkillOpt: Treating an Agent's Skill File as a Trainable Weight

Hong-Wei Wu avatarHong-Wei Wu  published on 2026-07-22 included in  category Paper Introduction
SkillOpt treats an agent's skill file as a trainable weight: batched rollouts, a bounded edit budget, and a strict validation gate replace ad hoc prompt patching.
Read more...
 Large Language Model, Agent Memory, Prompting, Single-Agent
Featured image for Dropout Explained: The Simple Secret to Preventing Neural Network Overfitting

Dropout Explained: The Simple Secret to Preventing Neural Network Overfitting

Hong-Wei Wu avatarHong-Wei Wu  published on 2026-07-20 included in  category Essential AI Concept
Struggling with overfitting in your neural networks? Learn how the Dropout technique works to improve model generalization. A deep dive into its principles and why it's so effective.
Read more...
Featured image for Understanding Backpropagation: How Gradients Are Calculated

Understanding Backpropagation: How Gradients Are Calculated

Hong-Wei Wu avatarHong-Wei Wu  published on 2026-07-15 included in  category Essential AI Concept
How are the gradients in a neural network actually computed? This article defines the notation, then walks through all four backpropagation equations, BP(1) to BP(4).
Read more...
Featured image for An Introduction to Stochastic Gradient Descent

An Introduction to Stochastic Gradient Descent

Hong-Wei Wu avatarHong-Wei Wu  published on 2026-07-09 included in  category Essential AI Concept
Why is plain gradient descent too slow for training a neural network? Learn how stochastic gradient descent uses mini-batches, and what batch size and epoch mean.
Read more...
Featured image for Deep Learning Fundamentals: An Introduction to Gradient Descent

Deep Learning Fundamentals: An Introduction to Gradient Descent

Hong-Wei Wu avatarHong-Wei Wu  published on 2026-06-28 included in  category Essential AI Concept
Understand gradient descent through the ball-in-a-valley analogy: derive the gradient vector and the parameter update rule, and see what the learning rate does.
Read more...
  • 1
  • 2
  • 3
  • 4
  • 5
  • 6
  • …
  • 21
2022 - 2026 Hong-Wei Wu | CC BY-NC 4.0