Position Summary
IHS Markit is seeking an adept, architecturally minded Principal Data Engineer. The candidate has experience translating developer, data scientist, and business needs into a vision of what should be built. This means skillfully choosing and deploying big data technologies and infrastructure (e.g. Kafka, Spark, DynamoDB, Neo4j), building frameworks atop to facilitate autonomous use for these internal customers, and abstracting production solutions so they feel like “magic” for your stakeholders such that things “just fall into place.” As Principal Data Engineer, you have a diversity of software development experience rather than a single tool suite or paradigm. You are hands-on, data-driven, and highly collaborative. You should enjoy being “full stack” in the sense that you own a product from beginning to end by designing, constructing, integrating, testing, documenting, and supporting your creations. You have a passion for engineering best-practices and the ability to lucidly communicate with fellow engineers as well as non-technical colleagues. You will present and communicate team status to the Technology leaders and Executive team. Technical Business Analyst role with the above will be an added advantage. This role includes acting as an interface between the SME and the developers. You will be responsible for converting the SME requirements into a clearly defined user story.
Job Responsibilities
Assume technological and administrative responsibilities for a focused team (2-3 members)
Provide (thought) leadership in technology direction, technical services, vendor partnership, and industry standards adoption.
Are “biased to action” and not easily blocked by problems and difficulties, instead taking ownership
Believe in monitoring, QA, and security as a first-class citizen in any data product.
Able to understand requirements in context to design solutions, rather than take them at face value.
Excited to design data platforms and tools that abstract implementation details for developers, analysts, and data scientists, enabling data transit and storage “as a service.”
Dedicated to automation, documentation, and collaboration at all stages of the engineering workflow.
Sensitive to the balance of performance and cost with the ability to communicate and optimize for the requirements of each.
Passionate about mentoring colleagues and educating the organization on data engineering best practices.
Maintain an excellent understanding of the business long term goals and strategy and ensure that designs are aligned with these – able to see the forest through the trees.
Efficiently integrating new systems, programs, and applications with business operations and services.
Ensuring end-user proficiency with new systems, programs, and applications across departments.
Education / Experience
Degree in Computer Science, related field, or equivalent experience.
Eight (8) or more years of increasing responsibility in technical data roles, with 3 or more years of experience as a data engineer lead.
Expertise in various big data technologies both open source and cloud native, AWS preferred (Kafka/Kinesis, Spark/EMR, Snowflake, Presto/Athena, Airflow, Hive, Drill).
Expertise in data model design with sensitivity to usage patterns and goals – schema, scalability, immutability, idempotency, etc.
Mastery of at least two of the following languages – Scala, Python, Java, Go.
Expertise in the suite of NoSQL models and frameworks.
Track record of choosing the right transit, storage, and analytical technology to simplify and optimize user experience.
Real-world experience developing highly scalable solutions using micro-service architecture designed to democratize data to everyone in the organization.
Able to function autonomously and successfully in ambiguous situations.
Inclusion and diversity are critical to the success of IHS Markit, and we actively encourage applications from people of all backgrounds. We are committed to providing equal employment opportunity without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, status as a protected veteran, or any other protected category. For more information on the many ways in which we enthusiastically support inclusion and diversity efforts for both candidates and employees, please access our Inclusion & Diversity Statement here.
We are proud to provide reasonable accommodations to applicants with disabilities. If you are interested in applying for employment with IHS Markit and need special assistance or an accommodation to use our website or to apply for a position, please contact ([email protected]) or call +1 212 849 0399. Determination on requests for reasonable accommodation are considered on a case-by-case basis. This contact information (email and phone) is intended for application assistance and accommodation requests only. We are unable to accept resumes or provide information about application status through the phone number or email address above. Resumes are only accepted through the online application process, and only qualified candidates will receive consideration and follow-up.
IHS Markit maintains a substance-free workplace; employees may be asked to submit to a drug test (where permitted by law). In addition, in order to comply with applicable federal, state, and local vaccine mandates (including those in place for US federal contractors), US employees may be required to provide proof of being fully vaccinated, unless they have been approved for an accommodation due to a medical reason, a sincerely held religious belief or another legally protected reason. T he company also participates in the E-Verify Program to confirm eligibility to work in the US.
For information please click on the following links:
IHS Markit Business Code of Conduct (https://investor.ihsmarkit.com/static-files/86e1cd0a-429d-4398-9f95-c54d4c2fa1e0) Right to Work EEO is the Law (https://www.dol.gov/sites/dolgov/files/ofccp/regs/compliance/posters/pdf/eeopost.pdf) EEO is the Law Supplement Pay Transparency (https://www.dol.gov/sites/dolgov/files/OFCCP/pdf/pay-transp_%20English_formattedESQA508c.pdf)
Current Colleagues
If you are currently employed by IHS Markit, please apply internally via the Workday internal careers site.