Orchestrating Analytics and AI Workflows at Telia with Arjun Anandkumar

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Player FM - Internet Radio Done Right

تمت الإضافة منذ قبل four أعوام

المحتوى المقدم من The Data Flowcast. يتم تحميل جميع محتويات البودكاست بما في ذلك الحلقات والرسومات وأوصاف البودكاست وتقديمها مباشرة بواسطة The Data Flowcast أو شريك منصة البودكاست الخاص بهم. إذا كنت تعتقد أن شخصًا ما يستخدم عملك المحمي بحقوق الطبع والنشر دون إذنك، فيمكنك اتباع العملية الموضحة هنا https://ar.player.fm/legal.

Crimes of the Times

1
The Dungeon: Inside Men’s Central Jail 30:16

منذ 9 أيام30:16

التشغيل لاحقا

قوائم

إعجاب

احب

30:16

A young FBI agent named Leah Marx arrives in Los Angeles and receives a tip in 2010 about brutal conditions at Men’s Central Jail downtown. Such complaints have gone nowhere for years, since they pit the allegations of inmates against the word of jail deputies. But she finds informants, including a wily bank robber, Anthony Brown, who is facing life in prison and is willing to help. She reflects on a family tragedy that informs her perspective and fuels her sense of mission. Meanwhile, an ambitious young jailer named James Sexton works his way through the ranks, trying to overcome his image as a “brass baby,” the son of a prominent law officer, while navigating a complicated agency where loyalty is a prime value. That jail was notorious for violence and neglect, and outside investigations had rarely gained traction. By entering Men’s Central Jail, the FBI was challenging a department that had long resisted oversight. The series is reported and hosted by Pulitzer Prize-winning journalist Chris Goffard, best known for his work on Dirty John. Topics in this episode include: Operation Pandora’s Box, Anthony Brown informant, James Sexton, Los Angeles County Jail scandal, FBI investigation, Sheriff Lee Baca.…

منذ عام واحد 26:00

MP3•منزل الحلقة

The future of data engineering lies in seamless orchestration and automation. In this episode, Arjun Anandkumar, Data Engineer at Telia, shares how his team uses Airflow to drive analytics and AI workflows. He highlights the challenges of scaling data platforms and how adopting best practices can simplify complex processes for teams across the organization. Arjun also discusses the transformative role of tools like Cosmos and Terraform in enhancing efficiency and collaboration.

Key Takeaways:

(02:16) Telia operates across the Nordics and Baltics, focusing on telecom and energy services.

(03:45) Airflow runs dbt models seamlessly with Cosmos on AWS MWAA.

(05:47) Cosmos improves visibility and orchestration in Airflow.

(07:00) Medallion Architecture organizes data into bronze, silver and gold layers.

(08:34) Task group challenges highlight the need for adaptable workflows.

(15:04) Scaling managed services requires trial, error and tailored tweaks.

(19:46) Terraform scales infrastructure, while YAML templates manage DAGs efficiently.

(20:00) Templated DAGs and robust testing enhance platform management.

(24:15) Open-source resources drive innovation in Airflow practices.

Resources Mentioned:

Arjun Anandkumar -

https://www.linkedin.com/in/arjunanand1/?originalSubdomain=dk

Telia -

https://www.linkedin.com/company/teliacompany/

Apache Airflow -

https://airflow.apache.org/

Cosmos by Astronomer -

https://www.astronomer.io/cosmos/

Terraform -

https://www.terraform.io/

Medallion Architecture by Databricks -

https://www.databricks.com/glossary/medallion-architecture

Thanks for listening to “The Data Flowcast: Mastering Airflow for Data Engineering & AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.

#AI #Automation #Airflow #MachineLearning

70 حلقات

#Tech #Airflow

Orchestrating Analytics and AI Workflows at Telia with Arjun Anandkumar

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

published منذ عام واحد