A federal watchdog has found that government-controlled Fannie Mae and Freddie Mac may have lost more than $3 billion from big banks’ alleged rigging of a key interest rate.

The staff of the inspector general for the Federal Housing Finance Agency, which oversees the two mortgage giants, gave the estimate in an internal memo obtained by The Associated Press. It recommended that the FHFA consider suing banks over the LIBOR rate.