{ "componentChunkName": "component---src-templates-blog-post-js", "path": "/find-duplicate-rows-in-a-pandas-dataframe/", "result": {"data":{"markdownRemark":{"html":"

Let’s read the budget.xlsx file into a DataFrame.

\n
import pandas as pd\n\nbudget = pd.read_excel("budget.xlsx")\n\nbudget
\n

Output:

\n

\n \n \n \n \n

\n

We can see that we have duplicate rows in our DataFrame.

\n

We can extract these duplicate rows using the duplicated() method.

\n
duplicates = budget.duplicated()\n\nduplicates
\n

The duplicated() method returns a boolean Series.

\n

Output:

\n

\n \n \n \n \n

\n

Note that the first occurrence of the row is marked as False (i.e. non-duplicate).

\n

Next,we extract the duplicate rows as shown below:

\n
budget[duplicates]
\n

Output:

\n

\n \n \n \n \n

\n
Learn how to remove duplicate rows from a pandas DataFrame in my blog post here.
\n","frontmatter":{"title":"Find Duplicate Rows in a Pandas DataFrame","date":"2021-08-08"}}},"pageContext":{"slug":"/find-duplicate-rows-in-a-pandas-dataframe/","prev":{"fields":{"slug":"/filter-a-pandas-dataframe-based-on-a-condition/"},"frontmatter":{"modules":null}},"next":{"fields":{"slug":"/pandas-isnull-and-notnull/"},"frontmatter":{"modules":null}}}}, "staticQueryHashes": ["3159585216"]}