Plastic milk containers can be cut into little plant markers and just use a permanent pen to write the name of the plant.

Or

You know how when you purchase items & sometimes in comes in those transparent plastic packaging, that are semi hard, and shaped to fit the item for protection. These also make good plant markers

Both are durable