VS Team System for Testers provides functionality that would work well for this, you can find more information about that here: http://msdn.microsoft.com/vstudio/teamsystem/tester/
To do this from a console application you'll first need a datasource that contains all of your inputs and the expected output then you can go through your datasource row by row and call your web method with that input and validate the actual output against the expected output and log the results to someplace you can easily review them when the test has completed.
|