Author Image

Welcome to Datamorfose

Hello, I'm Luciana Nobre!

Data Engineer at Datamorfose.

I’m a data engineer with experience in Python, data architectures and modeling, knowledge of distributed data processing, pipeline implementation, AWS Cloud data tools, and an analytical mindset. Datamorfose was born with the aim of sharing knowledge and motivating continuous learning. Through my experience and opportunities, I will share content about the world of data. Currently, I work as a Data Engineer in the financial market and have participated in large projects involving infrastructure and data product migrations, development, automation, and maintenance of data pipelines, among others. I invite you to visit the blog and embark on this journey of constant learning with me!

AWS Certified Data Engineer
AWS Certified Solutions Architect – Associate
AWS Certified Cloud Practitioner
Analytical
Communication
Hard Working

Skills

Experiences

1
Data Engineer
Itaú Unibanco.

Jun 2021 - Present, Remote, Brazil

Itaú Unibanco is a leading financial institution in Brazil and Latin America, offering a wide range of banking, insurance, investment, and credit card services. Headquartered in São Paulo, Brazil, Itaú Unibanco is known for its market presence, innovation, and leadership in cloud-native development.

Responsibilities:
  • Data Engineering Professional
  • Privacy Champion (LGPD)
  • Doc Advocate
  • Participation in Data Battle 2022, 21st ed. – Finalist – 3rd place
  • Participation in Data Battle 2023, Champions Edition
  • Sustentation and modernization of on-premises and cloud Hadoop central Data Lake.
  • Project, develop, and implement scalable and high-performance data pipelines, managing data architecture.
  • Develop and optimize data pipelines for ingestion, transformation, and loading (ETL) of data in distributed and real-time environments.
  • Automate data management and monitoring tasks using relevant tools and scripts.
  • Work with data to solve business problems, building and maintaining infrastructure to answer questions and improve processes.
  • Help simplify our data workflows, adding value to our product offerings and building the customer lifecycle.
  • Advocate for best practices and continuous learning.

Archivist / Data Analytics
Ecoagrícola Café Ltda

Dez 2015 - May 2021, Rio de Janeiro, Brazil

Sustainable coffee cultivation company recognized among the top 10 coffees in the world by the Cup of Excellence, located in Minas Gerais, Brazil.

Responsibilities:
  • Experience in enterprise information management.
  • Implementation of data module in Sankhya ERP system and creation of visualizations for analysis.
  • Responsible for data extraction, analysis, and dashboard creation for traceability, storage, and coffee quality, providing insights for decision-making.
  • Management of storage and availability for sale, including key market indicators such as daily dollar and BMF quotations.
2

3
Intern Archivist
Fundação Getulio Vargas FGV.

May 2015 - Dez 2015, Rio de Janeiro, Brazil

The Getulio Vargas Foundation is a Brazilian private institution of higher education, founded on December 20, 1944, with the initial objective of preparing qualified personnel for the public and private administration of the country.

Responsibilities:
  • Document management of the Documentation Center at the Getulio Vargas Foundation (NDoc)
  • Scanning, indexing, and physical and digital archiving ensuring accessibility and preservation of documentation.

Education

Projects

On-Premises to Cloud Migration
On-Premises to Cloud Migration
Data Engineer 2022

2023 Itaú Upwards Award - Responsible for organizing and planning the migration of over 4000 workflows of raw, transformed, and specialized data layers to Cloudera CDP - AWS.

IU Pippes 2.0 with Github Actions (CI/CD)
IU Pippes 2.0 with Github Actions (CI/CD)
Speaker 2023

I played an essential role in promoting and disseminating the tool, conducting presentations, sharing relevant content, and addressing users’ questions. My involvement significantly contributed to raising awareness about the tool and facilitating its adoption by users.

RIF Shortcut
Data Engineer, Speaker Jun 2023 - Present

A product created for data democratization, utilizing automated mapping of nested JSON schema for raw data ingestion. Through daily mapping of new fields, allowing schema evolution, generating necessary artifacts to achieve data democratization in a single day.

Publications

AWS Certified Data Engineer - My Experience with the Beta Exam
Medium 10 May 2024

It details the experience of obtaining the AWS Certified Data Engineer — Associate (DEA-C01) certification through the beta exam, highlighting motivations, challenges, preparation strategies, and practical tips. It analyzes the complexity of the exam, emphasizing the importance of practical and theoretical knowledge of AWS services and data engineering principles. It includes study recommendations for different experience levels, providing a comprehensive and detailed overview to help candidates adequately prepare and succeed in the certification and in their data engineering careers in the AWS cloud.

Recent Posts

Accomplishments

AWS Certified: Data Engineer – Associate
Amazon Web Services (AWS) Jan 2024 - Feb 2027

This certification helped me understand and validate the knowledge I’ve acquired. As it was a beta exam, lacking preparatory courses and with uncertainty about which topics to study, it provided an opportunity to assess my strengths and areas for improvement within the context of Data Engineering and data service integration in AWS. I was able to explore various data scenarios, focusing mainly on implementations, monitoring, and solutions for data pipelines, requiring an understanding of factors such as cost, operational effort, and performance.

Data Engineer Degree"
Data Science Academy Jun 2022 - Fev 2024

Over 300 hours of training in data engineering, where I developed practical and theoretical skills in topics such as: Data Warehouse Design and Implementation, Data Lake Design, Project, and Integration, Data Security and High Availability, Machine Learning and AI in distributed environments, and Analytics, Visualizations, and Reporting for decision-making with Big Data. Additionally, within this training, I had the opportunity to experiment with and practice various data tools and services such as: Docker, Postgres, Apache Hadoop, Apache Nifi, Apache Kafka, AWS Lake Formation, Amazon EMR, CDC, Dremio, Airbyte, Databricks, BigQuery, Apache Spark, Airflow, Snowflake, ElasticSearch, Scala, Cassandra, MongoDB, Azure Data Factory, and Power BI.

Other certifications and licenses
All Jan 2013 - Present

Other certifications and licenses acquired during my continuous learning.

Achievements

PRAD - High Performance Recognition Program

Champion in Data Battle

Data Science Postgraduate