Structured Factorizations in Scalar Product Spaces