Unitary circuits for strongly correlated fermions