Segment: Rework append_samples() so it can handle large input