Senior Data Engineer for Hire | LynxPro

Find

We use a highly curated database to find the candidate with the skills most suited to your business’s needs. Browse the talent below, find the perfect fit and our qualified customer service agents will take care of the rest.

Senior Data Engineer

Position London Rate 400£ - 600£ Travel Available to travel
 Over 13 years of experience in the areas of Big Data, Data Warehousing Technologies and followed by Big Data Testing and Software Testing and looking for a Senior Data Engineer/Big Data Lead position
 Proficient IT experience in Analysis, Design, Development, Testing and Implementation of business application systems for Process, Insurance, Finance and Telecom domains
 Experience in Big Data Architecture, Business & Data Analysis, Data Migration, Data Integration, Data Governance, Data Visualization and Reporting Services.
 Gathering business requirements for both functional and technical requirements that would best suit the needs of the technical architectural development process.
 Experience in deploying Hadoop cluster on Public and Private Cloud Environments like Cloudera and Amazon Web Services (AWS)
 Development experience with Spark processing using RDDs, DataFrames and SparkSQL
 Hands on experience on Cloudera Manager, HDFS, YARN, Hive, Hue, Hbase, Oozie and Zookeeper
 Proficient in Python and Scala coding
 Experience working with both Structured and Un-structured data
 Experience in setting up Sqoop and Kafka to load source data into HDFS.
 Well versed in Designing ETL(Informatica/Spark) mappings, Run ETL process using Big Data tools for various transactions and loading data from various legacy and disparate data sources to Data Lake or Enterprise Data Warehouse
 Extensive experience in Data Warehousing Techniques, concepts & architecture, producing solutions that enable the stakeholders to make informed decision, satisfying business objectives/goals
 Leading globally (UK, India and USA) distributed teams in an onsite/offshore model
 Well-versed with Data Visualization tools like Tableau
 Expertise in all phases of SDLC and STLC and involved in end to end lifecycle
 Exposure in Software Engineering Process and familiar with various Life Cycle Models like Agile (Scrum and TDD) and Waterfall model.
 Familiar with CI/CD (Continuous Integration & Delivery) development practice
 Expertise in data analysis with strong analytical skills and problem-solving skills.
 Strong experience on Defect Life Cycle and expertise in Test Management and Defect Management and experience on Project Management
 Experience working on CRM and Client facing applications.
 Quick learner and excellent Team player having ability to meet tight deadlines and work under pressure
 Strong Leadership (Teal Lead) qualities and able to competently drive forward the project activities independently
 Excellent Communication and Interpersonal skills and ability to quickly adopt technical challenges
more
Skills
aws
big-data
hive
python
scala
etl
git
github
hadoop
hdfs
informatica
kafka
oozie
redshift
s3
spark
[+] 13 more...
work Work Experience
More Work Experience
education Education and Training
More Education and Training
work Industry Skills