Natural Language Processing

How one can Use MultiIndex for Hierarchical Knowledge Group in Pandas

August 1, 2024
roosho

How one can Use MultiIndex for Hierarchical Knowledge Group in Pandas
Picture by Editor | Midjourney & Canva

 

Let’s learn to use MultiIndex in Pandas for hierarchical knowledge.

 

Preparation

 

We would wish the Pandas bundle to make sure it’s put in. You possibly can set up them utilizing the next code:

 

Then, let’s learn to deal with MultiIndex knowledge within the Pandas.

 

Utilizing MultiIndex in Pandas

 

MultiIndex in Pandas refers to indexing a number of ranges on the DataFrame or Sequence. The method is useful if we work with higher-dimensional knowledge in a 2D tabular construction. With MultiIndex, we will index knowledge with a number of keys and arrange them higher. Let’s use a dataset instance to know them higher.

import pandas as pd

index = pd.MultiIndex.from_tuples(
    [('A', 1), ('A', 2), ('B', 1), ('B', 2)],
    names=['Category', 'Number']
)

df = pd.DataFrame({
    'Worth': [10, 20, 30, 40]
}, index=index)

print(df)

 

The output:

                Worth
Class Quantity       
A        1          10
         2          20
B        1          30
         2          40

 

As you may see, the DataFrame above has a two-level Index with the Class and Quantity as their index.

It’s additionally attainable to set the MultiIndex with the prevailing columns in our DataFrame.

knowledge = {
    'Class': ['A', 'A', 'B', 'B'],
    'Quantity': [1, 2, 1, 2],
    'Worth': [10, 20, 30, 40]
}
df = pd.DataFrame(knowledge)
df.set_index(['Category', 'Number'], inplace=True)

print(df)

 

The output:

                Worth
Class Quantity       
A        1          10
         2          20
B        1          30
         2          40

 

Even with completely different strategies, now we have comparable outcomes. That’s how we will have the MultiIndex in our DataFrame.

If you have already got the MultiIndex DataFrame, it’s attainable to swap the extent with the next code.

 

The output:

                Worth
Quantity Class       
1      A            10
2      A            20
1      B            30
2      B            40

 

In fact, we will return the MultiIndex to columns with the next code:

 

The output:

 Class  Quantity  Worth
0        A       1     10
1        A       2     20
2        B       1     30
3        B       2     40

 

So, the way to entry MultiIndex knowledge in Pandas DataFrame? We will use the .loc methodology for that. For instance, we entry the primary stage of the MultiIndex DataFrame.

 

The output:

 

We will entry the info worth as properly with Tuple.

 

The output:

Worth    10
Identify: (A, 1), dtype: int64

 

Lastly, we will carry out statistical aggregation with MultiIndex utilizing the .groupby methodology.

print(df.groupby(stage=['Category']).sum())

 

The output:

 

Mastering the MultiIndex in Pandas would mean you can acquire perception into hierarchal knowledge.

 

Extra Sources

 

 
 

Cornellius Yudha Wijaya is a knowledge science assistant supervisor and knowledge author. Whereas working full-time at Allianz Indonesia, he likes to share Python and knowledge ideas by way of social media and writing media. Cornellius writes on quite a lot of AI and machine studying matters.

Leave a Reply