Senior Data Engineer (Fintech) - 12 months (€600 a day)

Senior Data Engineer (Fintech) - 12 months (€600 a day)

 

Want to join a major Fintech / Banking organisation to work in a services team within the Security Innovation area where you will be working on projects to help fight crypto fraud and prevent money laundering using state of the art tools to build models for AI & Machine Learning  

responsible for expanding and optimizing our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams  support our Software Engineers, Quality Engineers, Data Scientists and Platform Architects among other stakeholders on data initiatives and will ensure optimal data delivery architecture in an Agile / SAFe/ Scrum methodologies and well experienced in data pipeline builder optimizing data systems and building them from the ground up.

 

• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using ETL processes and modern cloud technologies.

 

YOU

5 years’ experience with big data tools: Hadoop, Spark, Databricks, Kafka, etc. Storm, Spark-Streaming, etc. with some experience in Financial services / Banking

Relational SQL and NoSQL databases, including Oracle and CosmosDB stream-processing systems: Storm, Spark-Streaming,

Java, Python experience

knowledge of message queuing, stream processing, and highly scalable big data stores

Advanced SQL working with relational databases, query authoring etc

Experience building and optimizing data pipelines, architectures and data sets.

Experience performing root cause analysis on internal and external data and processes  

Strong analytical skills working with unstructured datasets.

Build processes supporting data transformation, data structures, metadata, dependency and workload management.

A successful history of manipulating, processing and extracting value from large disconnected datasets.

Working knowledge of message queuing, stream processing, and highly scalable big data stores in cloud services.

 

€600 a day Hybrid roles 2 days a week in Dublin