Knowledge Engineering — ORM and ODM with Python | by Marcello Politi | Jan, 2025

Picture by David Clode on Unsplash

Manipulate database information leveraging an object-oriented programming paradigm

When engaged on information science initiatives, one elementary pipeline to arrange is the one relating to information assortment. Actual-world Machine Studying primarily differs from Kaggle-like issues as a result of information will not be static. We have to scrape web sites, collect information from APIs, and so forth. This fashion of amassing information may look chaotic, and it’s! That’s why we have to construction our code following greatest practices to deliver some kind of order to all this mess.

When you recognized the sources from which you need to collect your information, you have to accumulate them in a structured method to retailer these in your database. For instance, you may resolve that to be able to practice your LLM what you want are information sources which include 3 fields: writer, content material, and hyperlink.

What you might do is to obtain the information, after which write SQL queries to retailer and retrieve information out of your database. Extra generally you may need to implement all of the queries to carry out CRUD operations. CRUD stands for create, learn, replace, and delete. These are the 4 primary features of persistent storage.