Can identity providers work without storing any user data?

Is it reasonable to think about an authentication solution where the identity provider does not hold any user-data (hence acts as a stateless server) and the service provider (or relying party) gets verified data directly from the end-user?