Typical cmake builds for windows honor the BUILD_SHARED_LIBS setting and produce either a static or a shared library output, but not both. The current cmake build will produce both. See: https://cmake.org/cmake/help/latest/variable/BUILD_SHARED_LIBS.html
I forgot to add, when build a static library with any debug information in it (Debug, RelWithDebInfo), it is also typical yo change the debugging flag to /Z7 so the debugging information is placed directly into the static library, rather than in an accompanying PDB file.