preprocessing-data-with-automated-pipelines
Process automate data cleaning, transformation, and validation for ML tasks. Use when requesting "preprocess data", "clean data", "ETL pipeline", or "data transformation". Trigger with relevant phrase
Files9
View on GitHubSKILL.mdbundled/skills/preprocessing-data-with-automated-pipelines/SKILL.md
GitHubData Preprocessing Pipeline
Positioning
Use this skill as the direct owner for ML input-preparation pipelines.
It covers preprocessing-heavy tasks where the requested deliverable is a repeatable pipeline for cleaning, encoding, transforming, and validating input data.
When to Use
Use this skill when:
- Prepare raw data for machine learning models.
- Automate data cleaning and transformation processes.
- Implement a robust ETL (Extract, Transform, Load) pipeline.
Not For / Boundaries
- Whole-task ML ownership: use
scikit-learnorml-pipeline-workflow - Leakage and prediction-time auditing: use
ml-data-leakage-guard - Grouped scientific preprocessing with stronger methodological constraints: use
scientific-data-preprocessing
Typical Outputs
- A preprocessing pipeline plan or implementation sketch
- Clear sequencing for clean, encode, transform, and validate steps
- Notes that identify where leakage review, training, or evaluation should be run next
Related Skills
ml-data-leakage-guardbefore trusting fitted preprocessing stepssplitting-datasetswhen the next narrow problem is partition strategy