We study correlation functions of determinant-like operators in the "chiral
algebra subsector" of four-dimensional ${\cal N}=4$ gauge theory with $U(N)$
gauge group. We map the the large-$N$ saddles of the correlation functions to
specific semiclassical D-branes in the holographic dual BCOV theory. We present
a detailed match of several gauge-theory and BCOV calculations.