It's a book that has multiple chapters.
It's the transition from 10-20 page "stories" to full-fledged novels. Beginning books are short enough that the entire book is essentially a single chapter. Chapter books will be longer (40+ pages), will have a real plot and character development, and, as a result, have chapter breaks, just like grown-up books.