Experiences with custom CoreML models?

For those who've created custom CoreML models: What challenges did you face in data capture, annotation, and training? I'm considering developing a tool to simplify this process. Would this be useful? What features would you need?