1.Facultad de Estudios Superiores Cuautitlan -UNAM Cuautitlan, Edo de Mex., México 2.Mesoamerican Center for Theoretical Physics, UNACH, Chiapas, México 3.CIFFU and Facultad de Ciencias Físico - Matemáticas, Benemérita Universidad Autónoma de Puebla Apdo. Postal 1364, C.P. 72000, Puebla, Pue. México 4.Departamento de Gravitación y Altas Energías, Facultad de Ciencias Universidad Nacional Autónoma de Honduras Ciudad Universitaria, Tegucigalpa M.D.C. Honduras Received Date:2020-08-13 Available Online:2021-02-15 Abstract:We present a SUSY model with four Higgs doublets of the "private type," in which all fermion types (up, down, and charged leptons) obtain their masses from a different Higgs doublet $H_f\,( f = u_1, d, e)$. The conditions for anomaly cancellation imply that the remaining Higgs doublet of the model ($H_{u_2}$) must have the same hypercharge as $H_{u_1}$, and thus, can only couple to up-type quarks, which opens the possibility to have FCNCs only in this sector. We study the Lagrangian of the model, and in particular, the Higgs potential, to identify the Higgs mass-eigenstates and their interactions; for the Yukawa matrices, we consider the four-texture case. We obtain constraints on the model parameters by using LHC measurements on the properties of the 125 GeV Higgs boson (h), and identify viable regions of the parameter space. Subsequently, these constraints are used to evaluate the prospects for detecting the FCNC decay mode $t \to ch$ at the future high-luminosity (HL) option for the LHC, which are compared with current limits from LHC-run2. Moreover, we evaluate the FCNC decay of the next heavier Higgs boson $H_2\to tc$, which can typically reach $BR(H_2 \rightarrow tc) \approx {\cal{O}}(10^{-4}-10^{-5} )$. The search for the signal at HL-LHC is also studied, and it is found that it may be detectable for specific regions of the model parameter space.
HTML
--> --> --> -->
A.Model superpotential
The starting point when studying the Higgs and Yukawa sectors in a supersymmetric model is to describe the corresponding superpotential. This model includes four Higgs chiral superfields, each of which includes both the scalar and fermion components, namely the Higgses and Higgsinos. Owing to the anomaly cancellation, two of these, $ \hat{H}_{u1}, \hat{H}_{u2} $, should have a weak hypercharge $ Y = -1 $, whereas the other two, $ \hat{H}_{d} $ and $ \hat{H}_l $ must have $ Y = +1 $. The general superpotential includes the usual MSSM Yukawa term ($ W_{\rm Yuk} $) and the μ-terms, which now take the following form:
Thereafter, the rules of supersymmetry can be followed to derive the scalar Higgs potential. That is, the corresponding F-terms are derived from the superpotential, following which the D-terms are added. Finally, the allowed SUSY soft-breaking terms need to be included. In turn, the form of the Yukawa superpotential ($ W_{\rm Yuk} $) is dependent on whether or not one accepts a certain level of FCNCs in the model, which should come with a suppression mechanism to satisfy the current FCNC bounds. However, as we are interested in the class of models in which the masses of the leptons and up- and down-quarks originate from their private Higgs doublets, the possibilities are quite limited. Furthermore, given the assignment of hypercharges, the model is quite constrained. That is, if the masses of the down-quarks and leptons originate from two of the Higgs doublets, namely $ \hat{H}_{d} $ and $ \hat{H}_l $, respectively, the only remaining possibility is to have FCNCs in the up-quark sector, because the remaining Higgs superfields $ \hat{H}_{u1}, \hat{H}_{u2} $ are those that can couple with up-type quarks (and up-type squarks). Thus, the Yukawa superpotential of our model takes the form:
There are many possibilities for motivating the private Higgs assignments; for example, one can use a set of discrete symmetries. Thus, the mass matrix for the up-type quarks will receive contributions from two Yukawa matrices, which will induce FCNC-Higgs couplings for up-type quarks①. These assignments can be obtained in various manners, such as incorporating a set of discrete symmetries ($ k_u, k_d, k_l $) with parities, as indicated in Table 1.
$ H_u,\bar{u} $
$ H_d,\bar{d} $
$ H_l,\bar{l} $
Q
L
$ k_u $
$ - $
+
+
+
+
$ k_d $
+
$ - $
+
+
+
$ k_l $
$ - $
+
$ - $
+
+
Table1.Discrete symmetries for our SUSY 4HDM.
The power of these discrete symmetries is such that it permits the classification of different types of multi-Higgs models. For example, when considering a two-Higgs doublet model (2HDM), one can discuss types I, II, or III; in this model, both doublets $ H_u $, $ H_d $ have the same quantum numbers, so in principle, both could couple to all fermion types, and type III would be mandatory. However, owing to the selection of appropriate discrete symmetries, one can build a model in which only one Higgs doublet couples to each fermion type (2HDM of type II) or only one doublet performs the task of generating all fermion masses (as in the 2HDM type I). Similarly, we can use the discrete symmetries of Table 1 to define our "SUSY private Higgs model," which only allows FCNCs in the up sector, and not for the down type quarks and leptons. Other discrete symmetries could be used to forbid FCNCs completely, but having a fourth Higgs doublet with the correct quantum numbers makes it more natural to explore possible FCNCs in the up type quarks. The discrete symmetries may cause some of the μ-terms to vanish. Furthermore, these discrete symmetries may be imposed on the soft-breaking terms. Thus, the question arises as to whether the resulting Higgs spectrum is viable, namely one can have a light SM-like Higgs boson with $ m_h = 125 $ GeV, accompanied with heavier neutral and charged Higgs bosons that are sufficiently heavy to satisfy the current bounds from the LHC on extra Higgs particles. This is demonstrated in the following section, after discussing the minimization of the Higgs potential and Higgs mass matrices. 2B.Higgs potential of SS-4HDM -->
B.Higgs potential of SS-4HDM
In this section, we discuss the general Higgs potential for the supersymmetric model with four Higgs doublets, following the notation of Ref. [19]. After discussing the minimization conditions, the general form of the Higgs mass matrices is derived. The Higgs doublets are the scalar components of the Higgs chiral multiplets, and are written as follows:
As in the MSSM, $ H_{ui} $ should have a hypercharge that is equal to ?1, whereas it is +1 for $ H_{d,l} $. The Higgs doublets with a hypercharge of +1 give mass to the down-type quarks sector $ (H_d) $ and charged leptons $ (H_l) $. As demonstrated in [19, 20], the scalar potential of the Higgs fields takes the following form:
where $ H_{d_2} = H_l $. In general, the parameters $ \mu_{ij} $, $ \tilde{m}_{ui,di} $, and $ b_{ij} $ can be complex, but for the sake of simplicity in this paper, we take them to be real parameters. The VEVs are parametrized in terms of the total SM VEV (v), and the angles $ \alpha,\;\beta $ and $ \omega $, as follows:
The minimization conditions $ \dfrac{\partial V}{\partial H_{ui}^0} = 0 $ and $ \dfrac{\partial V}{\partial H_{di}^0} = 0 $ evaluated in the VEVs take the following form:
where $ \Delta_{u1} = \mu_{11}^2+\mu_{12}^2+\tilde{m}_{u1}^2 $, $ \Delta_{d} = \mu_{11}^2+\mu_{21}^2+\tilde{m}_{d}^2 $, $ \Delta_{u2} = \mu_{21}^2+ \mu_{22}^2+\tilde{m}_{u2}^2 $, and $ \Delta_{l} = \mu_{12}^2+\mu_{22}^2+\tilde{m}_{l}^2 $. In this case, we have renamed $ \tilde{m}_{d2} = \tilde{m}_{l} $. This will be used next in the construction of the Higgs mass matrices. 2C.Higgs mass matrices -->
C.Higgs mass matrices
We consider the CP-invariant case and focus on the neutral CP-even Higgs fields, which are obtained from the real parts of the neutral components. In the basis ($ H_{u1}^0,H_{d1}^0, H_{l}^0, H_{u2}^0, $), the mass matrix can be expressed as follows:
These expressions are used in the following to derive the Higgs interactions with fermions and gauge bosons. 2E.Higgs boson spectrum -->
E.Higgs boson spectrum
At this point, we should verify that the resulting Higgs spectrum is viable, namely that we have a light SM-like Higgs boson with $ m_h = 125 $ GeV, accompanied with heavier neutral and charged Higgs bosons, which are in agreement with the current LHC bounds on the Higgs particles. To explore the model parameters and symmetries, we consider the case in which the discrete symmetries for the Yukawa sector also apply for the supersymmetric $ \mu $-terms, namely $ \mu_{ij} = 0 $. In this case, it is relevant to include the leading SUSY radiative corrections to the Higgs mass, which are dominated by the stop-top loops. These radiative corrections are dependent on the stop-top interactions, for which we neglect the flavor-violating interactions, as we know that the current bounds on the FCNC processes causes them to be small, which is a consistent approximation. Following the effective potential technique to include the leading radiative stop-top corrections, we obtain the following expression for the mass of the lightest Higgs boson ($ h ( = H_1) $):
Similar formulae can be derived for the mases of the heavier CP-even Higgs bosons. Then, in Fig. 1(a) we show $ m_h $ as a function of $ \tilde{m}_{d} $ for the stop mass $ m_{\rm stop} = 1 $ TeV, where the different lines correspond to the soft Higgs mass parameter $ \tilde{m}_{u1} = $300, 400, 500, 600, 700 GeV, and for the fixed value $ \tilde{m}_l = 500 $ GeV, whereas the b-terms are fixed as $ b_{11} = 550 $ GeV and $ b_{21} = 50\;{\rm{GeV}} $. The relevant angles are selected as follows: $ \alpha = 0.01, \, \beta = 0.45, \, \omega = 0.37, \, \delta_1 = 0.31, \, \delta_2 = 0,37, \delta_3 = 2.1 $.② We can observe that the experimental value $ m_{h} \simeq 125 $ GeV (solid horizontal line) crosses all of the lines indicated in Fig. 1(a). Figure1. (color online) (a) Values of $ m_{h} $ as function of $ \tilde{m}_{u1} $, (b) contour regions of $ m_{H_2} $ in plane $ \tilde{m}_{u1}- \tilde{m}_{d} $, (c) contour regions of $ m_{H_3} $ in plane $ \tilde{m}_{u1}- \tilde{m}_{d} $, and (d) values of $ m_{H_4} $ as function of $ \tilde{m}_{u2} $.
Thereafter, in Figs. 1(b)-(c), we present the contour regions for the mass of the heavier scalars $ m_{H_i} $ ($ i = 1,2 $) in the plane $ \tilde{m}_{u1}vs\tilde{m}_{d} $, assuming again that $ m_{\rm stop} = 1\;{\rm{TeV}} $. Our selection for the remaining parameters is the same as that for $ m_h $ (in Fig. 1(a)), which is also assumed to evaluate $ m_{H_4} $, but in this case, the mass formula includes one extra free parameter: $ \tilde{m}_{u2} $, and we opt to plot $ m_{H_4} $ precisely as a function of $ \tilde{m}_{u2} $ (Fig. 1(d)). These parameters define our benchmark point, which not only produces the value $ m_h \simeq 125 $ GeV, but also achieves masses for the heavy Higgs bosons ($ H_2,\; H_3,\; H_4 $), which are larger than approximately $ O(0.5) $ TeV. In fact, we can observe from Figs. 1(b), (c), and (d) that the masses of the heavier Higgs bosons can fall within the range of 400 GeV to 1 TeV, which could be an interesting target for the HL-LHC. -->
A.Yukawa Lagrangian
The Yukawa Lagrangian for this model can be derived from the corresponding superpotential after eliminating the auxiliary fields (F-terms), and it can eventually be written as follows
Unlike the up sector, which interacts with two Higgs doublets simultaneously, the down type quarks and charged leptons only interact with a single one, implying that the corresponding mass matrices are given by
$ M_f = Y ^f \frac{v_f}{\sqrt{2}}, $
(36)
where $ f = d, l $. After rotating to the mass eigenstate basis, both the charged leptons and down type quark Yukawa matrices become diagonal:
$ \bar{Y}^f = \frac{\sqrt{2}}{v_f}\bar{M}_f. $
(37)
On the other hand, both Higgs doublets $ H_{u1} $ and $ H_{u2} $ couple with up-type fermions through the Yukawa matrices $ Y^u_1 $ and $ Y^u_4 $. Following spontaneous symmetry breaking, these matrices are combined to produce a fermion mass matrix with a certain structure. The corresponding mass matrix receives contributions from both VEVs $ v_1 $ and $ v_4 $; that is:
To obtain the physical fermion masses, we need to diagonalize the mass matrix, which is achieved through a bi-unitary transformation $ {\cal{V}}_{\rm L,R} $; that is,
where the form of the matrix $ {\cal{V}}_{\rm L,R} $ depends on the texture type of $ M_u $; closed expressions have been obtained for the four- and six-texture Hermitian and non-Hermitian cases. Although $ {\cal{V}}_{\rm L,R} $ diagonalizes the matrix $ M_u $, it does not necessarily diagonalize each of the Yukawa matrices that constitute $ M_u $; thus, a neutral flavor that violates the Higgs-fermion interactions will be induced in principle. 2B.FCNC Higgs interactions and up-type quark mass matrix with four-texture type -->
B.FCNC Higgs interactions and up-type quark mass matrix with four-texture type
In the use of textures within the context of the 2HDM, a specific form with six zeroes was first considered [24], and it was found that the textures implied a pattern for the Higgs-fermion couplings of the form $ \dfrac{\sqrt{m_im_j}}{v} $, which is known asthe Cheng-Sher ansatz. Such a vertex satisfies limits on the FCNC mediated by the Higgs bosons, with masses that are lighter than $ {\cal{O}} $(TeV). The case with four-zero textures was presented in [25, 26], and its implications were studied in [27-30]. Other variations of the Yukawa matrices were discussed in [31-33]. For completeness, we include the form of the four-zero texture matrix, namely
We assume that the Yukawa matrices in the up-sector ($ Y^u_{1}, Y^u_{4} $) have this four-texture structure, but rather than focusing on a specific model, we consider the general features of this case. We invoke this mass texture to control the FCNC Higgs interactions, but the phenomenology will be analyzed in terms of the Yukawa matrix elements in the mass-basis. The Lagrangian for the up-quarks sector is
where $ V_{\rm L,R} $ denote the diagonalizing matrices in the up-quark sector and $ \tilde{Y}^u_{1,4} $ are the rotated Yukawa matrices in the mass-basis. Then, in the mass basis, the Yukawa lagrangian becomes:
and it can be observed that $ \bar{M}_u $ is diagonal whereas $ \tilde{Y}^u_i $ are not, with $ i = 1,4 $. When rewriting the Lagrangian in terms of $ \tilde{Y}^u_{4} $, one obtains:
From the last equation, it can be observed that it is now only necessary to provide information regarding the $ \tilde{Y}^u_4 $ matrix. Subsequently, we simply need to express the neutral fields $ \eta_{1,2} $ in terms of the Higgs mass eigenstates to derive the Higgs-fermion couplings in the up sector. Thus, by using Eq. (26), we obtain the Higgs couplings in the up-type quark sector (with $ c^{-1}_\omega = 1/\cos \omega $),
Moreover, we can derive the $ h_iVV $ couplings by expanding the covariant derivatives of the Higgs doublets. The couplings $ h_iWW $ are expressed as follows:
Similar results are obtained for the vertices $ h_iZZ $. Having determined all of the relevant Higgs couplings, we are ready to work on the Higgs phenomenology. However, prior to this, we find it interesting to comment on the MSSM limit of our model. In fact, this was discussed in Ref. [34], which works in the so-called Higgs-basis, where only two doublets develop VEVs. The authors of this reference discussed in detail the issue of the decoupling limit, and although they confirmed that the model was reduced to the SM, in the limit in which all mass-parameters are very large; that is, with no non-decoupling effects from the extra degrees of freedom, they also identified several "quasi-decoupling" effects, which prevented the model from being reduced to the MSSM in that limit. This is owing to the mixing with the extra Higgs doublets, unless the extra b-terms are set to zero, such that no mixing is allowed. However, when using our parameterization for the VEVs, we can observe that in the limits $ \alpha \to 0 $ and $ \omega \to 0 $, the leptons are massless, whereas the fourth Higgs doublet does not develop a VEV. Furthermore, by taking $ \delta_2, \delta_3 \to 0 $, we notice that the third and fourth neutral CP-even Higgs bosons ($ H_3, H_4 $) do not mix with the two lightest MSSM-like Higgs bosons $ H_1 ( = h) $ and $ H_2 $. Thus, this limit resembles the MSSM Higgs sector, but with massless leptons.
IV.MODEL CONSTRAINTS FROM LHC HIGGS SEARCHESHaving analyzed the Yukawa and Higgs sectors, we can focus on the constraints of the 4HDM parameters involved in our study. For this purpose, we need to specify possible values for the following parameters: ● The mixing angles $ \delta_i $ ($ i = 1,\,2,\,3 $) that appear in the rotation mass matrix; Eq. (28). ● Angles that parameterize the VEVs: $ \alpha,\,\beta,\,\omega $; Eq. (6). ● Heavy scalar masses: mainly $ m_{H_2} $. ● Yukawa matrix elements $ \left(\tilde{Y}_4^u\right)_{tt}\equiv Y_{tt} $ and $ \left(\tilde{Y}_4^u\right)_{tc}\equiv Y_{tc} $. Moreover, we need to specify the soft SUSY-breaking terms, but these are essentially fixed by requiring the light Higgs boson mass of 125 GeV and the remaining neutral CP-even Higgs masses to be larger than approximately 0.5 TeV. To provide a realistic scenario, we use the most up-to-date experimental measurements reported by the ATLAS and CMS collaborations [35, 36]; namely, the signal strengths $ {\cal{R}}_{X} $, which are defined as follows:
where $ \sigma(pp\to H_i) $ is the production cross-section of $ H_i $, with $ H_i = h,\,h^{{\rm{SM}}} $; here, h is the SM-like Higgs boson originating from an extension of the SM and $ h^{{\rm{SM}}} $ is the SM Higgs boson and $ BR(H_i\to X) $ is the branching ratio of $ H_i $ decaying into $ X = b\bar{b},\;\tau^-\tau^+,\;\mu^-\mu^+,\;WW^*,\;ZZ^*,\;\gamma\gamma $. From the Higgs-fermion couplings (Eq. (48)), we observe that the term outside the brackets must be close to the unity, while the second term inside the brackets must be close to zero to result in small derivations from the SM couplings. This is ensured by assuming that $ c_{\omega}\sim c_{\beta}\sim c_{\delta_i}\sim 1 $ and $ s_{\alpha}\ll 1 $. Figure 2 presents the plane $ c_{\delta_1}-c_{\delta_2} $, in which the filled areas represent the regions allowed by $ {\cal{R}}_{b} $ (green), $ {\cal{R}}_{\tau} $ (pink), $ {\cal{R}}_{W} $ (yellow), $ {\cal{R}}_{Z} $ (blue), and $ {\cal{R}}_{\gamma} $ (orange). In turn, the intersection of all allowed regions is represented by the red area. The graph was generated using the $ {\texttt{SpaceMath}} $ package [37]. In Table 2 we present the values for the additional parameters that are used to find that plane. Figure2. (color online) Allowed region in plane $ c_{\delta_1}-c_{\delta_2} $ from our analysis of the ratios $ {\cal{R}}_{b} $ (green), $ {\cal{R}}_{\tau} $ (pink), $ {\cal{R}}_{W} $ (yellow), $ {\cal{R}}_{Z} $ (blue), and $ {\cal{R}}_{\gamma} $ (orange) in plane $ c_{\delta_1}-c_{\delta_2} $. The red area represents the intersection of all individual allowed regions.
Parameter
Value
$c_{\omega}$
$0.93$
$s_{\alpha}$
$0.01$
$c_{\beta}$
$0.9$
$(\tilde{Y}^u_4)_{tt}$
$0.1$
Table2.Values for additional parameters used to evaluate ${\cal{R}}_{x\bar{x}}$.
Furthermore, we are required to determine the values of the matrix elements $ Y_{tc} $ (in the following, we denote $ Y_{tc} = (\tilde{Y}^u_4)_{tc} $), because it is a fundamental parameter in our analysis, as we are interested in possible evidence of the flavor-changing decays $ H_2\to tc $ and $ t\to ch $, the couplings of which are proportional to $ Y_{tc} $. To constrain this, we first consider the high-energy constraints originating from the LHC bounds on the rare top decay $ t \to ch $, following which we compare this with the low-energy constraints, particularly $ D-\bar{D} $ mixing. For the high-energy constraints, we use the direct upper limit on $ BR(t\to ch)<1.1\times 10^{-3} $ [38]; with this value, we obtain a bound on $ Y_{tc} $ of order 1, depending on the values of $ c_{\beta} $. Nevertheless, the authors of Ref. [39] obtained an estimation by extrapoling the number of events for the signal and backgrounds from 36.1 to 3000 fb$ ^{-1} $, assuming that the experimental details and analysis remained unchanged. This resulting upper limit is given by $ BR(t\to ch)<7.69\times 10^{-5} $. Figure 3 depicts the allowed regions in the plane $ c_{\beta}-Y_{tc} $, where the shaded areas represent the allowed regions obtained from the direct upper limit reported in Ref. [38] on $ BR(t\to ch) $ (blue area) and by the extrapolation analysis (red area). We note that, by considering $ c_{\beta} = 0.9 $ (see Table 2), $ Y_{tc} $ can reach a value of up to approximately 0.4, after taking into account the extrapolation analysis. Figure3. (color online) Plane $ c_{\beta}-Y_{tc} $. The filled areas represent the allowed regions from the direct upper limit reported by the ATLAS collaboration on $ BR(t\to ch) $ (blue region) and by extrapolation (red region).
Regarding the low-energy constraints, Ref. [40] presented a detailed analysis of the FCNC arising from the 2HDM by incorporating the Cheng-Sher anzast, where the couplings of the Higgs bosons ($ H_a $) with fermions $ f_i f_j H_a $ were of the form $ \chi^a_{ij}(m_i m_j)^{1/2}/v $. It was found that the limits on the coefficients $ \chi^a_{ij} $ lay in the range $ 0.1-0.5 $, which already required some moderate fine-tuning. However, such analysis does not apply completely to our model, as in our case, there are extra suppression factors originating from the mixing angles. In particular, the low-energy-constraints on the parameter $ Y_{tc} $, resulting from the one-loop contribution to the $ D-\bar{D} $ mixing with neutral Higgs exchange, were considered recently in Refs. [41, 42], with further comments in Ref. [43]. It was found that the bound on the product $ |\rho_{tc} \rho_{tu}| \leqslant 0.02 $, with $ \rho_{tc} \simeq g_{H_2tc} $, modulo a certain mixing-angle factor. Within our model, we find that the coupling $ H_2 tc $ is approximately $ g_{H_2tc} \simeq 10^{-4} $ for $ Y_{tc} \simeq 0.1 $, which satisfies this constraint. Regarding the tree-level neutral Higgs contribution to $ D-\bar{D} $ mixing, which is sensitive to $ Y_{uc} $, we have obtained an estimate of this effect for the parameters (mixing angles) that are favored by the Higgs LHC data. We worked along the lines of the analysis presented in Ref. [44], which was conducted for 2HDM-III and claims that no significant bound on $ Y_{uc} $ is obtained for that model. We find that the contributions from the lightest neutral Higgs bosons within our model (h and $ H_2 $, with $ m_{H_2} = 400 $ GeV) are below the experimental uncertainties, even for $ Y_{uc} = 1.5 $. Thus, our model parameters satisfy all low-energy constraints, and in fact, the strongest constraints will result from the LHC studies. Table 2 summarizes the benchmark point for the parameters of our model to be used in the subsequent calculations. Furthermore, we set $ c_{\delta_1} = c_{\delta_2} = 0.95 $, unless stated otherwise.
-->
A.Search for decay $ {t\to c h} $ at LHC
The branching ratio for the decay $ t\to c h $ at the tree level can be to computed through the following expression:
$ {BR}(t\rightarrow c h) = \frac{\Gamma(t\rightarrow ch)}{\Gamma_{\rm tot}}, $
(63)
where the total top width is given by $ \Gamma_{\rm tot} = \Gamma(t\to Wb)+ \Gamma(t\to ch) $ GeV and the width for the FCNC top decay is
where $ g_{htc} $ is obtained by Eq. (48), $ r_{ht} = m_{h}/m_{t} $, $ r_{tc} = m_{c}/m_{t} $, and $ v = 246 $ GeV. In Fig. 4, we display $ BR(t\to ch) $ as a function of $ Y_{tc} $, where we use values for the additional parameters as indicated in Table 2. We observe that the top FCNC branching ratio can reach values of the order $ 10^{-4} $, which is very promising and motivates us to undertake a study of the detectability of the signal at the future stages of the LHC. Figure4. (color online) Branching ratio of decay $ t\to ch $ as function of $ Y_{tc}. $
The analysis is carried out for the LHC and its next stage; that is, the HL-LHC [50]. We first discuss both the signal and main SM backgrounds for the decay channels of the Higgs boson to be considered. We adopt the strategy carried out by the ATLAS and CMS collaborations [51, 52]. ● Signal We consider top pair production, and subsequently, one top is decayed via the FCNC mode, whereas the other one is decayed through the SM mode. Thus, the signature is $ pp\to t\bar{t}\to hc+Wb\to Xc+\ell\nu_{\ell}b $, and we consider the Higgs decays$ X = \gamma\gamma $ or a $ b\bar{b} $ pair. Thus, we identify the final state by the modes $ \gamma\gamma bj\ell\nu_{\ell} $ or $ b\bar{b}bj\ell\nu_{\ell} $. ● Background 1. In the case of the diphoton-channel, we study the backgrounds resulting from: – $ pp\to t\bar{t}h $, – $ pp\to hjjW^{\pm} $, – $ pp\to t\bar{t}\gamma\gamma $, – $ pp\to \gamma\gamma jj W^{\pm} $. 2. For the mode $ bb-channel $, we include the background from: – $ pp\to t\bar{t}\to b\ell^+\nu\bar{b}\bar{c}s+X $ or $ pp\to t\bar{t}\to bc\bar{s}\bar{b}\ell^-\bar{\nu}+X $ with a c-jet that is mis-identified as a b-jet, – $ pp\to t\bar{t}\to b\ell\nu\bar{b}u\bar{d} $, – $ pp\to b\bar{b}b\bar{b}\ell\nu $, and – $ pp\to b\bar{b}c\bar{c}\ell\nu $. However, regarding our computation scheme, we first implement the Feynman rules of the model via $ {\texttt{LanHEP}} $ routines for $ {\texttt{MadGraph5}} $ [53] and $ {\texttt{CalcHEP}} $ [54]. In this manner, the signal and background events are generated by $ {\texttt{MAdGraph5}} $ interfaced with $ {\texttt{Pythia6}} $ [55] and $ {\texttt{Delphes3}} $ [56] for the detector analysis. We generate $ 10^5 $ events for both the signal and background using the CT10 parton distribution functions [57]. We now turn to evaluate the number of signal events produced as a function of $ c_{\beta} $ and $ Y_{tc} $. In Fig. 5, we present the signal events for the (a) diphoton-channel and (b) $ bb-channel $ in the plane $ c_{\beta} $-$ Y_{tc} $ for the HL-LHC, with an integrated luminosity of $ 3 $ ab$ ^{-1} $. We observe that the number of signal events produced at the HL-LHC will be of the order 250 (60000) for the diphoton-channel ($bb-channel$), assuming $ Y_{tc}\sim 0.4 $ and $ c_{\beta}\sim 1 $. For the LHC, the number of signal events is approximately $ 0.1 $ (one tenth) of the events expected for the HL-LHC. Figure5. (color online) Number of signal events as function of $ c_{\beta} $ and $ Y_{tc} $ for (a) diphoton-channel and (b) $ bb-channel $. In both cases, we use the optimal integrated luminosity searched by the HL-LHC. We use the parameters presented in Table 2.
The ATLAS and CMS collaborations [51, 52] searched for the decay $ t\to ch $ in both the diphoton-channel and bb-channel; nevertheless, no significant deviation from the SM prediction was observed. We follow these strategies, using the same kinematic cuts, for our analysis. These cuts are: ● diphoton-channel 1. We require exactly one $ b- $jet and two photons. 2. We identify the charged leptons and photons emerging from the signal imposing $ p_T^{\gamma,\,\ell}>25 $ GeV. 3. The main variable for searching the Higgs boson decay into the diphoton system is the invariant mass $ M_{\gamma\gamma} $, which is selected to lie between $ 120\leqslant M_{\gamma\gamma}\leqslant 130 $ GeV. 4. Owing to the Higgs boson decays into the diphoton system, it is required that the invariant mass associated with the top quark falls between $ 160\leqslant M_{\gamma\gamma j}\leqslant 190 $ GeV. 5. The separations between the photons resulting from Higgs boson decay must be $ 1.8<\Delta R_{\gamma,\,\gamma}<5.0 $. 6. The separation between the diphoton system and jet is $ \Delta R_{\gamma\gamma,\,j}<1.8 $. 7. Owing to the non-detected neutrino in the final state, we demand a missing transverse energy $ {\not\!\! E}_T>30 $ GeV. 8. The tagging and mistagging efficiencies selected are as follows: – $ \epsilon_b = 70 $%, – $ \epsilon_c = 14 $%, and – $ \epsilon_j = 1 $%. ● bb-channel 1. We require exactly four jets: three of them are tagged as $ b- $jets with $ p_T^{j,\,b}>30 $ GeV and $ |\eta^j<2.5| $. 2. Exactly one isolated lepton with $ p_T^{\ell}>20 $ GeV and $ |\eta^{\ell}| < 2.5. $ 3. To obtain a neutrino that emerges in the final state, the missing transverse energy $ {\not\!\! E}_T>30 $ GeV is required. 4. To reconstruct the top quark mass associated with the FCNC, it is required that $ |M_{b_1b_2j}-m_t|\leqslant 26 $ GeV. 5. Regarding the reconstruction of the Higgs boson mass, it is imposed that $ |M_{b_1b_2}-m_h|\leqslant 0.15\;m_h $. 6. It is required that $ \Delta R $ between each jet and charged lepton be $ \sqrt{\Delta\phi^2+\Delta\eta^2}>0.4 $. 7. The tagging and mistagging efficiencies selected are as follows: – $ \epsilon_b = 70 $%, – $ \epsilon_c = 14 $%, and – $ \epsilon_j = 1 $%. Subsequently, we evaluate the signal significance $ {\cal{S}} = N_{\rm S}/\sqrt{N_{\rm S}+N_{\rm B}} $, where $ N_{\rm S} $ is the number of signal events and $ N_{\rm B} $ is the number of background events, once the kinematic cuts have been applied. Figure 6 presents the corresponding signal significance that can be achieved at the HL-LHC, as a function of $ c_{\delta_1} $ and $ Y_{tc} $. Figure6. (color online) Signal significance as function of $ c_{\delta_1} $ and $ Y_{tc} $: (a) bb-channel and (b) diphoton-channel. We set $ c_{\delta_2} = 0.95 $ and the parameters indicated in Table 2. The regions constrained by the LHC Higgs data, as derived in the previous section, are also shown.
We can appreciate that for both channels, the values of the significance are of the order 1 for $ c_{\delta_1} $ within the range allowed by $ {\cal{R}}_X $ and $ Y_{tc}\sim {\cal{O}}(0.4) $. 2B.Search for decay $ H_2\to tc $ at LHC -->
B.Search for decay $ H_2\to tc $ at LHC
First, we evaluate the relevant decay modes of $ H_2 $ into final states with two particles; the corresponding branching ratios are presented in Fig. 7, with (a) the modes at the tree level and (b) the modes at the one-loop level. Figure7. (color online) Branching ratio of decays $ H_2\to XX $: (a) tree level modes and (b) one-loop level modes. We use the values of the parameters indicated in Table 2.
We observe that the FCNC mode $ H_2 \to tc $ reaches values of the order $ 10^{-4} $ for a mass $ m_{H_2} \sim 2 m_t $. Above this mass, this branching ratio reaches values of the order $ 10^{-6}-10^{-5} $. The dominant decay modes for $ m_{H_2}\leqslant 2m_t $ are into $ bb $ and $ VV $ ($ V = \,W,\,Z $) pairs, for which the branching ratios are of the orders $ 0.9 $ and $ 10^{-2} $, respectively. Once the $ tt $ channel is open, it becomes the dominant decay mode, with a branching ratio of the order $ 1 $. Regarding the one-loop level decays, the mode $ H_2\to gg $ has the largest branching ratio, reaching values of the order $ 10^{-2} $ ($ 10^{-3} $) for $ m_{H_2}\leqslant 2m_t $ ($ m_{H_2}>2m_t $). The decay $ H_2\to\gamma\gamma $ has a branching ratio of the order $ 3 \times 10^{-4}-5\times 10^{-6} $ in the interval $ 2m_t-1000 $ GeV. Finally, we find that $ BR(H_2\to Z\gamma) $ can reach values as high as $ 7\times 10^{-5} $. For the production of the heavy Higgs boson, we focus on the gluon fusion mechanism, which is the dominant production mechanism for the SM case. The corresponding cross-section is displayed in Fig. 8(a), whereas the number of signal events, considering the optimal integrated luminosity ($ {\cal{L}} = 3 $ ab$ ^{-1} $) to be achieved at the HL-LHC, is depicted in Fig. 8(b). Figure8. (color online) (a) $ H_2 $ cross-section as function of $ m_{H_2} $through gluon fusion mechanism and (b) number of signal events at center-of-mass energy equal to 14 TeV and integrated luminosity of 3 ab$ ^{-1} $. We use the values of the parameters shown in Table 2.
As in the previous section, we first define both the signal and the main SM background processes, as follows: ● Signal: The signature searched is $ gg\to h_2\to tc\to b\ell\nu_{\ell}c $, where $ \ell = e,\,\mu $. ● Background: The dominant SM background processes to the final state $ bj\ell\nu_{\ell} $ originates from: 1. $ Wjj+Wb\bar{b}; $ 2. s and t channel single top $ tb+tj; $ 3. Another important background is the $ t\bar{t} $ production, where one of the two leptons is missed for both top quarks decaying semileptonically, or two of the four jets are missed when only one of the top quarks decays semileptonically. The kinematic cuts imposed are as follows: ● The main kinematic cut to isolate the signal is the transverse mass $ M_{\rm T} $, which is defined as:
Figure 9 presents the transverse mass distribution of the signal and backgrounds, without cuts, where we assume that $ BR(H_2\to tc) = 1 $ to highlight the signal. Thereafter, we impose the cut to highlight the signal. Subsequently, we impose the cut: $ m_{H_2}-15<M_{\rm T}^{\ell}<m_{H_2}+15 $ (GeV). Figure9. (color online) Transverse mass distribution without cuts.
● We require two jets with $ |\eta^j|<2.5 $ and $ p_{\rm T}^j>30 $ GeV, one of which is tagged as a b-jet. ● We require one isolated lepton ($ e\;{\rm{or}}\;\mu $) with $ |\eta^{\ell}|<2.5 $ and $ p_T^{\ell}>20 $ GeV. ● We also consider a cut for the missing transverse energy $ {\not \!\!E}_T>40 $ GeV owing to undetected neutrinos. After applying the above kinematic cuts (and also considering tagging and mistagging efficiencies as in the previous section) to the signal and main background processes, we can compute the signal significance, which is defined as $ N_{\rm S}/\sqrt{N_{\rm S}+N_{\rm B}} $, where $ N_{\rm S} $ ($ N_{\rm B} $) is the number of signal (background) events once the kinematic cuts have been applied. Meanwhile, in Fig. 10, we present the contours of the signal significance as a function of the Higgs boson mass $ M_{H_2} $, and display (in colors) the integrated luminosity. Figure10. (color online) Signal significance as function of integrated luminosity and $ m_{H_2} $, using parameters shown in Table 2.
From Fig. 10 that the largest significance can be achieved with the largest luminosity for a certain range of Higgs masses. For example, it will be possible to achieve a significance of 2.1$ \sigma $ for a luminosity of the order 3000 fb$ ^{-1} $ for $ m_{H_2}\sim 2m_t $, whereas in the final stage of the LHC (with an integrated luminosity of 300 fb$ ^{-1} $), the signal significance will only be approximately 0.75$ \sigma $.