If you prefer to use potted flowers, might try planting them into relatively small pots so that root growth is fixed.
Anything shorter can lead to it not tightly woven into the yarn, causing it to come lose and increase pilling. https://www.youtube.com/watch?v=gvbz6GTp-vc