Internship
BI Project from A-Z
Dive into my interesting internship at Algorythm .
Services
During my internship, I focused on data engineering, data science, and data visualization. Below is an overview of my timeline and the key activities I undertook:
🎥 Film & Video
Data extraction,
transformation, building and optimising data pipelines.
📸 Photography
Capture moments that move people.
Minimal, authentic, timeless.
💻 Web & Branding
Clean websites and visuals that make your brand rise & shine.
1. Data Engineering
The biggest challenge during the data engineering phase of the project was implementing Slowly Changing Dimension (SCD) Type 2. This process was exceptionally complex and required extensive testing and refinement to ensure it was implemented correctly.
We encountered various obstacles, including managing historical data, identifying changes in dimensions, and synchronizing updates across multiple tables.
Additionally, we faced some challenges with data quality. It was essential to resolve these issues before running the data pipelines. We had to apply various strategies to clean, transform, and validate the data to ensure that the resulting analyses and reports were reliable and accurate. This process required meticulous attention to detail and teamwork to develop an effective solution.
2. Data Science
The most challenging part of this application was undoubtedly converting the ChatGPT response into a usable note and separate code. This process brought several challenges, including handling complex strings and processing the output of the AI model. It took a lot of time and effort to find an effective solution, and ultimately, I decided to use a regex function to extract and structure the necessary information.
Another major challenge was consistently achieving reliable results from the AI model. It required continuous refinement of the model’s parameters and prompt engineering techniques to achieve the desired functionality. This included fine-tuning parameters such as temperature, max tokens, top p, and other settings to ensure that the generated text was accurate and relevant to the user’s specific needs. The process of iterative testing, adjusting, and optimizing was essential to achieve consistent and high-quality results.
See it for yourself by clicking the link below:
3. Data Visualisation
The biggest challenge was designing a user-friendly and informative dashboard that meets the client’s needs. We had to go through several iterations and integrate feedback to achieve optimal results.
See it for yourself by clicking the link below:
Internship Report
Here, you will find detailed information about my internship experience and the projects I worked on during my internship period. This report provides an in-depth analysis of my tasks, achievements, and learning experiences during this time. You may download the full report in English or Dutch by clicking on the link below.
Internship
Reflection
My internship in data engineering, data science, and data visualization provided invaluable hands-on experience and opportunities for growth. Collaborating with a diverse team, I developed practical skills in building data pipelines, conducting analysis, and communicating technical concepts effectively. I’m proud of the progress I made and the contributions to real-world projects. This experience has solidified my passion for data and enhanced my problem-solving abilities. For a concise reflection on my internship journey you may download the full report in English or Dutch by clicking on the link below.