Yes, the word “Congress” is capitalized because it is a proper noun referring to a governmental legislative body. The House of Representatives and the Senate are also capitalized.
Examples of capitalizing the word include the U.S. Congress, Congress, etc.
What about congressional?
Congressional is not a proper noun naturally, so it should be lowercased unless used in an official event title such as the “Congressional Baseball Game.”