Yesterday I was trying out the new features in junit 4.8.x and noticed that while Categories and SuiteClasses seem to be what I needed to group my tests into different "testing frameworks" I realized that the xml reports generated are not what I expected.
The total number of tests I run is around 60k. They're currently grouped into "testing frameworks" like frontend tests, backend tests, rdbms, api, webservices, etc. The tests are run through ant and these frameworks are just filesets that include or exclude different file directories. This seems to work fine for us, as the reports generated are per-class, so we can quickly know which class a specific test case belongs to.
The reason I wanted to define my "testing frameworks" using Categories or SuiteClasses is so that the group definition are closer to the java code and developers are more in control as opposed to having to manipulate the ant filesets.
However, when creating a "Frontend" Suite all the test methods in the frontend test classes are shown in a single report, so I don't know if testMethodA belongs to com.frontend.ClassATest or com.frontend.ClassBTest.
Is there a way to use Categories or SuiteClasses for my use case?