Python Tutorial

Python Flow Control

Python Functions

Python Data Types

Python Date and Time

Python Files

Python String

Python List

Python Dictionary

Python Variable

Python Input/Output

Python Exceptions

Python Advanced

How to Remove duplicates from list in Python

There are several ways to remove duplicates from a list in Python. Here are a few common methods:

  • Using a set (unordered, faster): If the order of the elements doesn't matter, you can remove duplicates by converting the list to a set and then back to a list. Sets don't allow duplicates, so this will give you a new list with unique elements.
original_list = [1, 2, 2, 3, 4, 4, 5]
unique_list = list(set(original_list))
print(unique_list)
  • Using a list comprehension (ordered, slower): If you want to maintain the order of the elements, you can use a list comprehension with a helper set to track the unique elements encountered.
original_list = [1, 2, 2, 3, 4, 4, 5]
unique_list = []
unique_set = set()

for item in original_list:
    if item not in unique_set:
        unique_list.append(item)
        unique_set.add(item)

print(unique_list)
  • Using a list and an OrderedDict (ordered, faster for larger lists): For larger lists, you can use an OrderedDict from the collections module to maintain the order of unique elements efficiently.
from collections import OrderedDict

original_list = [1, 2, 2, 3, 4, 4, 5]
unique_list = list(OrderedDict.fromkeys(original_list).keys())
print(unique_list)

Choose the method that best suits your needs, depending on whether you need to maintain the order of the elements and the size of the list.

  1. Python remove duplicates from list:

    • Description: Removing duplicates from a list using the set() method.
    • Code:
      original_list = [1, 2, 2, 3, 4, 4, 5]
      unique_list = list(set(original_list))
      print("Original List:", original_list)
      print("List with Duplicates Removed:", unique_list)
      
  2. Remove duplicate elements in Python list:

    • Description: Removing duplicate elements from a list using the set() method.
    • Code:
      original_list = [1, 2, 2, 3, 4, 4, 5]
      unique_list = list(set(original_list))
      print("Original List:", original_list)
      print("List with Duplicates Removed:", unique_list)
      
  3. Python list unique elements:

    • Description: Obtaining unique elements from a list using the set() method.
    • Code:
      original_list = [1, 2, 2, 3, 4, 4, 5]
      unique_elements = set(original_list)
      print("Original List:", original_list)
      print("Unique Elements:", list(unique_elements))
      
  4. Delete duplicate items in Python list:

    • Description: Deleting duplicate items from a list using a loop and a new list.
    • Code:
      original_list = [1, 2, 2, 3, 4, 4, 5]
      unique_list = []
      [unique_list.append(item) for item in original_list if item not in unique_list]
      print("Original List:", original_list)
      print("List with Duplicates Removed:", unique_list)
      
  5. Deduplicate list in Python:

    • Description: Deduplicating a list using a loop and a new list.
    • Code:
      original_list = [1, 2, 2, 3, 4, 4, 5]
      unique_list = []
      [unique_list.append(item) for item in original_list if item not in unique_list]
      print("Original List:", original_list)
      print("List with Duplicates Removed:", unique_list)
      
  6. Python set to remove duplicates from list:

    • Description: Using the set() method to remove duplicates from a list.
    • Code:
      original_list = [1, 2, 2, 3, 4, 4, 5]
      unique_list = list(set(original_list))
      print("Original List:", original_list)
      print("List with Duplicates Removed:", unique_list)
      
  7. List comprehension to remove duplicates in Python:

    • Description: Using list comprehension to create a new list without duplicates.
    • Code:
      original_list = [1, 2, 2, 3, 4, 4, 5]
      unique_list = [item for index, item in enumerate(original_list) if item not in original_list[:index]]
      print("Original List:", original_list)
      print("List with Duplicates Removed:", unique_list)
      
  8. Remove repeated elements from list in Python:

    • Description: Removing repeated elements from a list using a loop and a new list.
    • Code:
      original_list = [1, 2, 2, 3, 4, 4, 5]
      unique_list = []
      [unique_list.append(item) for item in original_list if original_list.count(item) == 1]
      print("Original List:", original_list)
      print("List with Repeated Elements Removed:", unique_list)
      
  9. Eliminate duplicates from list Python:

    • Description: Eliminating duplicates from a list using the set() method.
    • Code:
      original_list = [1, 2, 2, 3, 4, 4, 5]
      unique_list = list(set(original_list))
      print("Original List:", original_list)
      print("List with Duplicates Eliminated:", unique_list)
      
  10. Unique elements in Python list:

    • Description: Obtaining unique elements from a list using the set() method.
    • Code:
      original_list = [1, 2, 2, 3, 4, 4, 5]
      unique_elements = set(original_list)
      print("Original List:", original_list)
      print("Unique Elements:", list(unique_elements))