The question lacks to specify e.g, the type of X-ray radiation (energy of exciting electrons), or the nature of the target. In parts, arguments put forward by @Amir Kalashnikov
may be misunderstood as if concepts of classical optics (e.g., for a reflection target, as if the angle between the incident ray and the surface normalwould equate the angle between the surface normal and the reflected ray) like seen with visible light as e.g., with the photoelectric effect would always suffice.
The short answer:
Depending on the design and mode of operation of the X-ray source, you may have X-ray radiation in all directions around the target. What does not pass the window / collimators is leakage radiation to be attenuated by shielding by the X-ray tube, or its mount to protect an operator. The spatial distribution of this radiation around the the target may be mapped by a point detector, e.g., a counter tube, directed toward the source.

(example of an X-ray tube with rotating anode, image credit)
The longer answer:
X-ray sources with a solid target typically either deploy a high electron acceleration to harvest X-ray radiation across a thin transmission target. Or, with much lesser electron acceleration, use a massive reflective / thick target. These design principles affect the spatial intensity of X-ray photons around the target.
Addressing the professionals of radiology, Kahn's The physics of Radiation Therapy outlines the physics of generation of X-rays. While the following quote focuses on bremsstrahlung, similar properties may be anticipated for the characteristic X-ray radiation, too:
"Since an electron may have one or more bremsstrahlung interactions in the material and an interaction may result in partial or complete loss of electron energy, the resulting bremsstrahlung photon may have any energy up to the initial energy of the electron. Also, the direction of emission of bremsstrahlung photons depends on the energy of the incident electrons (Fig. 3.9). At electron energies below about $\pu{100 keV}$, x-rays are emitted more or less equally in all directions. As the kinetic energy of the electrons increases, the direction of x-ray emission becomes increasingly forward. Therefore, transmission-type targets are used in megavoltage x-ray tubes (accelerators) in which the electrons bombard the target from one side and the x-ray beam is obtained on the other side. In the low-voltage x-ray tubes, it is technically advantageous to obtain the x-ray beam on the same side of the target, i.e., at 90 degrees with respect to the electron beam direction." (Kahn, p. 34)
(The emphasis was added.)
The diagram, drawn for thin transmission targets in mind, is the one below:

(Kahn, p. 34)
For reflection targets with a normal tilted to the incident electron beam, the heel effect may distort the angular distribution of the bremsstrahlung around the X-ray target. This is because the intensity of X-ray photons generated in deeper layers of the target may be more attenuated by this very material than the by X-ray photons generated closer to the target surface.
For the interested:
Aiming for a high brilliance (i.e., high number of X-ray photons per time and beam size), both target designs are subject to modelling and simulation. This may be to identify an optimum for (electron) accelerator potential and target thickness:

(Photon generation for different W transmission targets, Nasseri 2016)
An other example -- after defining the target's design parameters -- may be about maping the space around the target:

(Omar 2018)

(Simulated spatial photon intensity distribution for a Mo reflection target, Omar 2020a)
References
Kahn, F. M.; Gibbons, J. P. Khan’s the physics of radiation therapy, 5th edition, 2014, Wolters Kluwers.
Nasseri, M. M. Determination of Tungsten Target Parameters for Transmission X-ray Tube: A Simulation Study Using Geant4 in NEK 48, 2016, 795-798; doi: 10.1016/j.net.2016.01.006, open access.
Omar, A.; Andreo, P.; Poludniowski, G. Performance of different theories for the angular distribution of bremsstrahlung produced by keV electrons incident upon a target in Rad. Phys. Chem. 148, 2018, 73-85; doi:/10.1016/j.radphyschem.2018.02.009.
Omar, A; .Andreo, P.; Poludniowski, G. A model for the energy and angular distribution of x rays emitted from an x-ray tube. Part I. Bremsstrahlung production in Med. Phys. 47, 2020, 4763-4774; doi: 10.1002/mp.14359, open access.
Omar, A; .Andreo, P.; Poludniowski, G. A model for the energy and angular distribution of x rays emitted from an x-ray tube. Part II. Validation of x-ray spectra from 20 to 300 kV in Med. Phys. 47, 2020, 4005-4019; doi: 10.1002/mp.14360, open access.