If I’m understanding you correctly, you are effectively looking for a “nested formset” structure, where each element of a formset contains a different formset for that specific item.
If that’s correct, then no - Django does not intrinsically provide this feature.
However, it is a topic that has been discussed here a few times in the past. You can search the forum for “Nested Formset” to find the topics.
A couple that I found quickly:
(There are others - this is a topic that comes up periodically.)