Most books about theatre and set/costume design are located in Zimmerman Library, but the Fine Arts and Design Library will also have some books about costume design and other arts-related aspects of Theatre. Note the library location before looking for a book you're interested in. When you find a book on the shelves, the books around it will be about related subjects.
Some call number ranges for theatre:
Literature (General). Drama: PN1600-3307