انتقل إلى وضع عدم الاتصال باستخدام تطبيق Player FM !
2#4 - Ole Olesen-Bagneux - Data Lifecycle, Search & Data Catalog (Eng)
Manage episode 342222247 series 2940030
"The data lifecycles collides with the system lifecycles. It’s a classic."
Let’s talk about the paradoxes of Data: Data Lifecyle, Search and Data Catalog!
What a fantastic chat Ole Olesen-Bagneux and I had! Ole is writing his O’Reilly book Enterprise Data Catalog, has newsletter Symphony of Search. He brings in a new perspective from Library and Information Science and is a great advocate for transforming the way we think around data and search.
Ole has worked as a specialist, as a leader and as an architect, and has an academical background as PhD in Information Science from University of Copenhagen.
Here are my key takeaways:
- Data Lifecycle was first mentioned as the POSMAD lifecycle
- Plan - Plan for creation
- Obtain - Acquire data
- Store - store it in a system
- Share - expose it and make it accessible
- Maintain - curate data, keep it accurate
- Apply - Use the data
- Dispose - Archive or delete
- Store, share and apply is where the business value is derived
- The points where you get value from data are normally not the same, we use to manage data.
- The work e.g. national archives do, in cataloguing, and readying data for research is done at the very last stage of the lifecycle. But the value resides much earlier in the lifecycle.
- Data-driven innovation, data-drive culture… What these terms actually mean is that we need to get better at utilizing the value insight data.
- Intangible assets hold the highest value - data is the key to value creation.
- One of the potentials of a data catalog is to push the high-level DM activities to earlier stages of the lifecycle.
- Catalogs are pushing inventory activities from the dispose phase to the store and share phase of the lifecycle.
- There is a huge difference in the perspective of an IT system lifecycle and data lifecycle.
- Data always resides in a system, and that system has its own lifecycle. These lifecycles do not match.
- If you do not maintain data in your systems, any potential data migration becomes exponentially more difficult. What do we migrate, what do we keep, what do we delete?
- The solution can be a Data Catalog and/or metadata repository with retention policies for data.
- The distinction between searching in and searching for data has become really important due to the rise of data science.
- When you search for data, you are looking at data sources with potential value to search in.
- Metadata is key in searching for data - that means we have to manage the metadata lifecycle as well.
- A data Catalog is basically just a search engine.
- Data Catalogs rely more and more on the same technology components as search engines for the web, e.g. knowledge graphs.
- The key capability of data catalogs is a metadata overview over the data in your company.
- Data catalogs have an untouched potential to ensure data lifecycle management
73 حلقات
Manage episode 342222247 series 2940030
"The data lifecycles collides with the system lifecycles. It’s a classic."
Let’s talk about the paradoxes of Data: Data Lifecyle, Search and Data Catalog!
What a fantastic chat Ole Olesen-Bagneux and I had! Ole is writing his O’Reilly book Enterprise Data Catalog, has newsletter Symphony of Search. He brings in a new perspective from Library and Information Science and is a great advocate for transforming the way we think around data and search.
Ole has worked as a specialist, as a leader and as an architect, and has an academical background as PhD in Information Science from University of Copenhagen.
Here are my key takeaways:
- Data Lifecycle was first mentioned as the POSMAD lifecycle
- Plan - Plan for creation
- Obtain - Acquire data
- Store - store it in a system
- Share - expose it and make it accessible
- Maintain - curate data, keep it accurate
- Apply - Use the data
- Dispose - Archive or delete
- Store, share and apply is where the business value is derived
- The points where you get value from data are normally not the same, we use to manage data.
- The work e.g. national archives do, in cataloguing, and readying data for research is done at the very last stage of the lifecycle. But the value resides much earlier in the lifecycle.
- Data-driven innovation, data-drive culture… What these terms actually mean is that we need to get better at utilizing the value insight data.
- Intangible assets hold the highest value - data is the key to value creation.
- One of the potentials of a data catalog is to push the high-level DM activities to earlier stages of the lifecycle.
- Catalogs are pushing inventory activities from the dispose phase to the store and share phase of the lifecycle.
- There is a huge difference in the perspective of an IT system lifecycle and data lifecycle.
- Data always resides in a system, and that system has its own lifecycle. These lifecycles do not match.
- If you do not maintain data in your systems, any potential data migration becomes exponentially more difficult. What do we migrate, what do we keep, what do we delete?
- The solution can be a Data Catalog and/or metadata repository with retention policies for data.
- The distinction between searching in and searching for data has become really important due to the rise of data science.
- When you search for data, you are looking at data sources with potential value to search in.
- Metadata is key in searching for data - that means we have to manage the metadata lifecycle as well.
- A data Catalog is basically just a search engine.
- Data Catalogs rely more and more on the same technology components as search engines for the web, e.g. knowledge graphs.
- The key capability of data catalogs is a metadata overview over the data in your company.
- Data catalogs have an untouched potential to ensure data lifecycle management
73 حلقات
كل الحلقات
×
1 4#11 - Kristiina Tiilas - The Role of Data Leadership in the Industrial Sector (Eng) 40:06

1 4#10 - Geir Myrind - The Revival of Data Modeling (Nor) 41:25

1 4#9 - Marte Kjelvik & Jørgen Brenne - Healthcare Data Management: Towards Standardization and Integration (Nor) 30:44

1 Holiday Special: Joe Reis - A Journey around the World of Data (Eng) 53:47

1 4#8 - Shuang Wu - Service Platform: From Analytics to AI-Driven Success (Eng) 41:11

1 4#7 - Victor Undli - From Hype to Innovation: Navigating Data Science and AI in Norway (Eng) 31:27

1 4#6 - Rasmus Thornberg - Decision Science and AI between Use Case and Product (Eng) 39:00

1 4#5 - Olga Sergeeva - Data and AI in Modern FMCG Supply Chains (Eng) 38:43

1 4#4 - May Lisbeth Øversveen - Data Strategy in Medium-sized organizations (Nor) 32:32

1 4#3 - Pedram Birounvand - A Paradigm Shift in Data through AI (Eng) 45:54

1 4#2 - Jonah Andersson - Journey to the Cloud: Cloud Migration, Edge AI, Data as a Service (Eng) 46:29

1 4#1 - Tiankai Feng - The Power of Communities - CoP, DAMA and Beyond (Eng) 37:37

1 3#19 - Yngvar Ugland - Unlocking Innovation: Digital Transformation, AI, and Tech Evolution (Nor) 48:00

1 3#20 - Ingrid Aukrust Rones - EU Policies, Big Tech, and Global Geopolitics (Eng) 55:10

1 3#18 - Erlend Aune - Bridging the Gap: Data Science Education and Industry Collaboration (Nor) 37:49
مرحبًا بك في مشغل أف ام!
يقوم برنامج مشغل أف أم بمسح الويب للحصول على بودكاست عالية الجودة لتستمتع بها الآن. إنه أفضل تطبيق بودكاست ويعمل على أجهزة اندرويد والأيفون والويب. قم بالتسجيل لمزامنة الاشتراكات عبر الأجهزة.