Find the count of duplicate items in a C# List

Question

I am using List in C#. Code is as mentioned below:

TestCase.cs

 public class TestCase
{
    private string scenarioID;
    private string error;

    public string ScenarioID
    {
        get
        {
            return this.scenarioID;
        }
        set
        {
            this.scenarioID = value;
        }
    }

    public string Error
    {
        get
        {
            return this.error;
        }
        set
        {
            this.error = value;
        }
    }

    public TestCase(string arg_scenarioName, string arg_error)
    {
        this.ScenarioID = arg_scenarioName;
        this.Error = arg_error;
    }
}

List I am createing is:

private List<TestCase> GetTestCases()
    {
        List<TestCase> scenarios = new List<TestCase>();
        TestCase scenario1 = new TestCase("Scenario1", string.Empty);
        TestCase scenario2 = new TestCase("Scenario2", string.Empty);
        TestCase scenario3 = new TestCase("Scenario1", string.Empty);
        TestCase scenario4 = new TestCase("Scenario4", string.Empty);
        TestCase scenario5 = new TestCase("Scenario1", string.Empty);
        TestCase scenario6 = new TestCase("Scenario6", string.Empty);
        TestCase scenario7 = new TestCase("Scenario7", string.Empty);

        scenarios.Add(scenario1);
        scenarios.Add(scenario2);
        scenarios.Add(scenario3);
        scenarios.Add(scenario4);
        scenarios.Add(scenario5);
        scenarios.Add(scenario6);
        scenarios.Add(scenario7);

        return scenarios;
    }

Now I am iterating through the list. I want to find the how many duplicate testcases are there in a list with same ScenarioID. Is there any way to solve it using Linq or any inbuilt method for List?

Regards, Priyank

http://stackoverflow.com/questions/5080538/c-sharp-determine-duplicate-in-list — assylias, Mar 28 '12 at 14:22
Using linq, group by scenarioID and then count the size of each group. Or create a Dictionary, using scenarioID as the key and storing the count of the id as the value. — phoog, Mar 28 '12 at 14:25

Daniel Hilgarth · Accepted Answer · 2014-07-01T11:13:43.827

20

Try this:

var numberOfTestcasesWithDuplicates = 
    scenarios.GroupBy(x => x.ScenarioID).Count(x => x.Count() > 1);

edited Jul 01 '14 at 11:13

answered Mar 28 '12 at 14:24

Daniel Hilgarth

166,158
40
312
426

Henk Holterman · Answer 2 · 2012-03-28T14:31:21.333

8

As a first idea:

int dupes = list.Count() - list.Distinct(aTestCaseComparer).Count();

edited Mar 28 '12 at 14:31

answered Mar 28 '12 at 14:23

Henk Holterman

250,905
30
306
490

@daryal - a better definition of equal (dupe) will be needed. As I tried to say, it's a rough sketch that solves the counting issue. – Henk Holterman Mar 28 '12 at 14:27
1

This will not work out of the box - you omitted the need to implement either a custom Equality comparer or override equality within OP's class – BrokenGlass Mar 28 '12 at 14:29
@broken - inserted a placeholder. – Henk Holterman Mar 28 '12 at 14:32

score 4 · Answer 3 · edited Oct 03 '13 at 10:28

4

var groups = scenarios.GroupBy(test => test.ScenarioID)
    .Where(group => group.Skip(1).Any());

That will give you a group for each ScenarioID that has more than one items. The count of the groups is the number of duplicate groups, and the count of each group internally is the number of duplicates of that single item.

Additional note, the .Skip(1).Any() is there because a .Count() in the Where clause would need to iterate every single item just to find out that there is more than one.

edited Oct 03 '13 at 10:28

nawfal

66,413
54
311
354

answered Mar 28 '12 at 14:25

Servy

197,813
25
319
428

`Skip(1).Any()` might be a better approach if you want to go that route – BrokenGlass Mar 28 '12 at 14:37
@BrokenGlass Yeah, both are constant time rather than O(n), but yours is indeed better; edited. – Servy Mar 28 '12 at 15:02

score 4 · Answer 4 · answered Mar 28 '12 at 14:26

4

To just get the duplicate count:

int duplicateCount = scenarios.GroupBy(x => x.ScenarioID)
                              .Sum(g => g.Count()-1);

answered Mar 28 '12 at 14:26

BrokenGlass

153,880
28
280
327

score 2 · Answer 5 · answered Mar 28 '12 at 14:26

2

Something like this maybe

var result= GetTestCases()
            .GroupBy (x =>x.ScenarioID)
            .Select (x =>new{x.Key,nbrof=x.Count ()} );

answered Mar 28 '12 at 14:26

Arion

30,443
10
68
86

score 1 · Answer 6 · answered Oct 03 '13 at 10:24

1

To get total number of duplicates, yet another:

var set = new HashSet<string>();
var result = scenarios.Count(x => !set.Add(x.ScenarioID));

To get distinct duplicates:

var result = scenarios.GroupBy(x => x.ScenarioID).Count(x => x.Skip(1).Any());

answered Oct 03 '13 at 10:24

nawfal

66,413
54
311
354

Find the count of duplicate items in a C# List

6 Answers6

Linked