
That's right!
As you correctly decided, the problem is that you are going to be representing back to the Government on the very same particular matter involving specific parties that you are working on. That's a violation of law (18 U.S.C. 205 to be precise).
Superb! Now let's investigate the area of "misuse of position".