Staff Data Engineer – Big Data in
- Translate business requirements and source system understanding into technical solutions using Opensource Tech Stack, Big Data & Java etc. * Work with business partners directly to seek clarity on requirements * Define solutions in terms of components, modules and algorithms * Design, develop, document and implement new programs and subprograms, as well as enhancements, modifications, and corrections to existing software. * Create technical documentation and procedures for installation and maintenance. * Write Unit Tests covering known use cases using appropriate tools * Integrate test frameworks in development process * Refactor existing solutions to make it reusable and scalable * Work with operations to get the solutions deployed * Take ownership of production deployment of code * Collaborating with and/or lead cross functional teams, build and launch applications and data platforms at scale, either for revenue generating or operational purposes * Come up with Coding and Design best practices * Thrive in self-motivated internal-innovation driven environment * Adapting fast to new application knowledge and changes • Master/Bachelor degree in Computer Science, Electrical Engineering, Information Systems or other technical discipline; advanced degree preferred. • Minimum of 8+ years of software development experience (with a concentration in data centric initiatives), with demonstrated expertise in leveraging standard development best practice methodologies. • Minimum 4+ years of experience in Hadoop using Core Java Programming, Spark, Scala, Hive, Pig scripts, Sqoop, and any ETL tool experience. • Strong knowledge of Database concepts and UNIX. • Expert on SQL skills for data manipulation (DML) and validation (SQL Server, DB2, Oracle). • Expertise in Object Oriented Programming Language – Java / Python. • Experience using CI/CD Process, version control and bug tracking tools. • Experience in handling very large data volume in low latency and batch mode. • Experience with automation of job execution, validation and compares of the data files on Hadoop Env at the field level. • Experience in leading a small team, and be a team player. • Strong communication skills with proven ability to present complex ideas and document in a clear and concise way. • Quick learner; self-starter, detailed and in-depth. Visa has adopted a COVID-19 vaccination policy. As a condition of employment, all employees based in the country where this job is located are required to be fully vaccinated for COVID-19, unless a reasonable accommodation is approved or as otherwise required by law.