Data Engineer

Mid-level Data Engineer talent pool in Toronto, focused on pipelines that fail loudly and can be rerun. This talent-pool listing is for a mid-level Data Engineer based in Toronto, Canada. Day to day, the focus is pipelines that fail loudly and can be rerun. A typical stretch of time is spent loading data, checking counts, and making a failed run obvious. Responsibilities - Own the pipeline run so the analyst who uses the table can see a failure that is visible without a separate explanation. - Every week, bring the count check up to date and resolve the rows in versus rows out before the next cycle. - Write the rerun in plain language and mention the how to run the job again safely in the same note. - If the schema stalls, say so the same day and state what you already did about a column change that was announced. - Keep the freshness in the shared tracker, not in a personal folder. - Treat the backfill note as finished only after you have checked the what a backfill will and will not rewrite. Requirements - Roughly 3 to 6 years of building data pipelines others can rerun that matches this data engineer profile, or a shorter record with the same kind of finished work. - Practical skill with SQL and a scheduler or orchestrator in data engineer work, not a certificate alone. - Able to explain what a backfill will rewrite to a colleague who was not in the room. - Careful with silent pipeline failures; this is checked in review of data engineer work. - For the data engineer brief in Toronto, use the working language of that assignment in Canada. Nice to have - Row-count checks is useful on data engineer assignments in Toronto, and it is not required. - People who have already done safe reruns can start this data engineer brief with less coaching. - Freshness is a plus for data engineer work based in Toronto. Skills SQL, data modelling, pipelines, orchestration, data tests, Python, access control, incident notes Working conditions This is an on-site data engineer listing in Toronto, Canada. Work happens at the assignment's premises. The usual week is Monday to Friday, on Eastern Time. The work can be remote. Pipeline failures sometimes need a look outside the normal day. Location The hiring base for this data engineer listing is Toronto, Canada. English is the working language for this Toronto brief. Qualified people are considered without regard to race, color, religion, sex, national origin, age, disability, or other characteristics protected by applicable law. This is a talent-pool listing. Your profile will be reviewed and matched to employer openings that fit; submitting an application does not guarantee an interview or placement.