Job Title: Sr. Data Engineer

No of positions: 3

Rate: $70.00

Client: Banking and Finance

Location: Richmond, VA

Required Skills: Amazon Web Services (AWS), Scala, Ab Initio, Spark, Python, PL/SQL, Java, Oracle

*These will be part of POD 1.
-3 spots: 1 Senior, 2 Upper Mid Level

Primary: Python, Ab Initio, AWS
Secondary: Spark, Scala/Java, Oracle PL/SQL

-Main requirements: building pipelines using Spark and Scala with Oracle experience

Data Track:
-current persistence layer is oracle 11g, want to migrate to 19c
-then they plan to go to RDS
-today they use goldengate for replication between 2 regions
-when it goes to cloud will use RDS

-All of the pipelines are Spark and Scala pipelines
-will use existing pipelines as foundation
-Spark Scala with python
-once our pipeline is built, there is a lot of integration required with our Tuning infrastructure
-Tuning is our tokenization platform: tokenize and detokenize sensitive data
-the pipeline will make a call to the Tuning service, wile it is migrating the data from the source to target, then the pipeline is migrating the data it will make a touring call.
-not expecting data engineers that have migration experience, but it would be nice to have.
-will be a real time pipeline, will need to do the change data capture, incremental data also needs to be migrated / one time activity will be 16TB of data plus any new data as part of the migration