Yes, state names should always be capitalized since they are proper nouns. Since they are specific locations, they need to follow capitalization rules for proper nouns.
Examples:
- Michigan, United States
- Virginia, United States
- Occitanie, France
- Bavaria, Germany
You should also always capitalize the word “state” if it follows the specific name of a state such as “California State.”