Something cannot be composed of potency. Potency is a capacity for a thing to change, it is not an element which can combine with something else. Only things which have a potency to be indepedent existing things can be elements of composition.
When we say something material is that which has parts, we imply that it is divisible. It is something which can be broken down into simpler elements. Certain powers, capacities, qualities, quantities, aspects, or features of things, however, do not have a potency for individual existence.
Hence, things which are not elements of composition (i.e. do not qualify as parts) are: Form, “being material”, color, intellect, will, being in relation, being a substance, having accidents, powers, potencies, or capacities. That is not a comprehensive list, but just some things that come to mind.
Now, how does potency relate to matter? Potency is not the same thing as matter at all. However, matter, by nature of being disvisible, always has potency. In many things, matter accounts for all of the potency that a thing has. While matter may be the primary sourece of motency in material things, immaterial things have a different source of potency, and that is powers. Powers like intellect and will have their own potency which is not derived from matter (because intellect and will, and any being with intellect and will, are immaterial).