Hello Judy,

Thank you for sending in your picture. It look like your roses are infected with the fungus that causes rose rust. High humidity and cool temperatures (64 to 69°F) favor the development of this disease.  Transmission of the fungal spores occurs via insects, rain, or wind.

The following information can be found in the first link below.

“ Rose rust is a disease caused by the fungi Phragmidium species. It causes orange-colored spots to appear on stems and leaves. When rust is severe, an orange dust-like substance may be present on the plant surface and on the ground below the plant. Rose rust attacks all plant parts except the roots and petals. Severely diseased leaves of highly susceptible cultivars may turn yellow or brown and drop.

Prevention & Treatment: Provide good air circulation. Do not plant roses in crowded areas and prune plants to keep the centers open. Water plants before noon and avoid getting the leaves wet. Remove and destroy diseased leaves and plants. Fungicides containing myclobutanil, mancozeb or propiconazole are recommended for homeowner use”.

As with any chemical control, use caution, read all labels and directions, and do not overapply or improperly apply fungicides.

More information.

Rose Diseases | Home & Garden Information Center (clemson.edu)

Rose Rust - How do you treat and control rose rust naturally? (tamu.edu)

Rose Rust – Wisconsin Horticulture

I hope this information helps you out.  If you have further concerns don't hesitate to Ask extension.