Python remove duplicates from list

The easiest way to remove duplicates from the list (in other words deduplicate) is to convert the list to set and then convert back to the list.

my_list = [1, 2, 4, 6, 6, 3, 6, 5, 5, 9, 2]
print(f"List with duplicates: {my_list}")

dedup_list = list(set(my_list))
print(f"List without duplicates: {dedup_list}")

Output:

List with duplicates: [1, 2, 4, 6, 6, 3, 6, 5, 5, 9, 2]
List without duplicates: [1, 2, 3, 4, 5, 6, 9]

Drawback for some use cases ⁠– this way doesn't preserve element order. If you need keep an order, then see below.

Remove duplicates from list python with preserving order

dedup_list = []
for i in my_list:
  if i not in dedup_list:
    dedup_list.append(i)

#python
menu 11
Roman Ivashchenko profile picture
Nov 10, 2020
by Roman Ivashchenko

Best related

What is python max int?

What is python max int?

#python #math
Flask vs django | easy expert comparison

Flask vs django | easy expert comparison

#python #django #flask
Simple way to add counts to Django admin filter

Simple way to add counts to Django admin filter

#django #python
Unsupported operand types [python is easy]

Unsupported operand types [python is easy]

#python
Weighted choice in python

Weighted choice in python

#python #statistics
Python absolute value

Python absolute value

#python #math
Python create folder

Python create folder

#python
Resort mp3 for players that order by date

Resort mp3 for players that order by date

#python #mp3
Python i++ increment

Python i++ increment

#python #increment
Parallel execution of asyncio functions

Parallel execution of asyncio functions

#asyncio #python

Other by Roman Ivashchenko

Weighted average python

Weighted average python

#python
CRUD in python [Simplest example]

CRUD in python [Simplest example]

#python
[Easy python] loop through files in directory

[Easy python] loop through files in directory

#python
[Learn python] get last element in list

[Learn python] get last element in list

#python
Learn python – find index of all occurrences in list

Learn python – find index of all occurrences in list

#python
Convert list to tuple - Python is easy

Convert list to tuple - Python is easy

#python
[Easy Python] int object is not callable

[Easy Python] int object is not callable

#python #pythonbasics
[Easy Python] continue vs pass

[Easy Python] continue vs pass

#python
Check if string is substring of another in python

Check if string is substring of another in python

#python
Python not implemented exception

Python not implemented exception

#python