Original Article Stakeholders’ Perceived Effectiveness of Public E-Procurement through Government E-Marketplace in India INTRODUCTION Adopting
electronic procurement (E-procurement) systems has transformed traditional
procurement, significantly impacting government and public sector transactions.
The push toward digital governance in India has placed E-procurement as a
pivotal strategy for enhancing transparency, accountability, efficiency, and
effectiveness in procurement processes. These shifts reflect broader global
trends in public procurement reforms, driven by the need to reduce corruption
and promote a seamless, business-friendly environment. E-procurement became a
strategic priority of the government of India under Digital India Program
launched in 2015. Government e-Marketplace (GeM), launched in 2016 as an
initiative of Digital India, offers a centralized platform for government
agencies to procure goods and services, aiming to reduce corruption, streamline
workflows, and encourage fair competition among suppliers. This study
examines the perceived effectiveness of E-procurement in promoting good
governance. The study explores the perceptions of both buyers and suppliers
engaged with GeM, focusing on the multidimensional aspects that influence their
experiences. While prior studies have highlighted the potential of
E-procurement to improve governance, this research uniquely examines how buyers
and suppliers perceive GeM's functionalities differently. By identifying core
dimensions—such as operational transparency, reduction of favoritism, and
professionalism—this study aims to provide insights into the strengths and
areas for improvement within GeM, aligning with good governance practices. The study draws
upon the Technology Acceptance Model (TAM), Good Governance Theory, and Public
Value Theory to explore the role of E-procurement in fostering good governance
through GeM. These frameworks provide insights into technology adoption,
governance principles, and the creation of public value, which are central to
understanding the perceptions of procurement agencies and suppliers. Previous research
on public E-procurement systems has highlighted their transformative potential
in addressing inefficiencies and malpractices in public procurement. Studies by
Neupane
et al. (2014) and Intauno
et al. (2024) demonstrate how E-procurement platforms
enhance transparency and accountability, thereby mitigating corruption in
public procurement processes. Aboelazm
(2022) emphasizes that digital tools streamline
procurement workflows, reduce transaction costs, and improve efficiency. These
insights are particularly relevant for policymakers aiming to foster good
governance, as they highlight the value of E-procurement in aligning
procurement practices with principles of transparency, equity, and operational
excellence. For practitioners, the operational benefits such as enhanced
supplier competition and improved market access provide a roadmap for adopting
digital procurement solutions. While prior
research has acknowledged the potential of E-procurement to enhance
transparency and reduce corruption in public procurement systems, most studies
have focused on technical implementation, policy frameworks, or case-specific
operational outcomes. However, limited attention has been paid to how different
stakeholder groups—specifically buyers and suppliers—perceive and experience
public E-procurement platforms like GeM. This study
addresses these gaps by providing a comparative, stakeholder-based analysis of
GeM adoption, grounded in well-established theoretical models. By applying
Exploratory Factor Analysis (EFA) to a robust sample from six North Indian
states, this research offers an understanding of the governance outcomes of
E-procurement from both demand and supply sides. This dual perspective
contributes novel empirical insights to the discourse on digital governance and
public procurement reforms in developing economies. The remainder of
this paper is structured as follows. The next section presents a comprehensive
literature review. The methodology section details the research design, data
collection, and analytical techniques used to examine the perceptions of buyers
and suppliers regarding the GeM. The findings section presents key results,
highlighting similarities and differences in stakeholder perceptions. This is
followed by the discussion section, which contextualizes the findings within
the theoretical framework and existing literature and explores their
implications. Finally, the paper concludes by summarizing key insights,
discussing limitations, and proposing directions for future research and policy
development. Review of Literature E-procurement has
garnered significant attention due to its numerous benefits in streamlining
procurement processes and enhancing governance outcomes Singh
and Vij (2022). Croom
and Brandon-Jones (2005) have cited cost savings, improved
transparency, process efficiencies and enhanced compliance and auditability as
possible advantages of E-procurement. Siwandeti
et al. (2023) explored the perceived benefits of
participation in public E-procurement among participating and non-participating
vendors in Tanzania, identifying reduced paperwork, increased transparency,
cost control, and corruption reduction as key advantages. E-procurement
enhances traceability in financial transactions Neupane
et al. (2014), brings openness in procurement processes Kassim
and Hussin (2010), Fridayani
and Atmojo (2017), Haninun
et al. (2023) and reduces information asymmetry in
procurement processes Croom
and Brandon-Jones (2007), Neupane
et al. (2014), promoting overall transparency Blum et al. (2023), Intauno
et al. (2024). Transparency has additional benefits, such
as increased accountability of procurement officials Croom
and Brandon-Jones (2005), Mpehle
and Mudogwa (2020). E-procurement
improves monitoring Rotich
and Okello (2015), automates workflows Shakya
(2015) and enhancing accountability. It also increases consistency Neupane
et al. (2014) and predictability Shakya
(2015) while promoting professionalism Brandon-Jones
(2017) and improving working methods Ferreira
and Amaral (2016). A significant advantage is the reduction in
lead time Belisari
et al. (2019), Egorova
et al. (2021) and greater accuracy in procurement
processes Toktaş-Palut
et al. (2014). E-procurement has
also been associated with wider vendor choice Moon et al. (2005), reduction in transaction costs Dooley
and Purchase (2006), Bromberg
and Manoharan (2015), Aboelazm
(2022) and lower prices of products and services Kassim
and Hussin (2010), Pai (2019), leading to significant budgetary savings Singer
et al. (2009), Blum et al. (2023) and ensuring value for money Afolabi
et al. (2022). Improvement in bargaining power facilitates
better negotiation with suppliers Kameshwaran
et al. (2007), Ferreira
et al. (2014). E-procurement also improves inventory
management Toktaş-Palut
et al. (2014), Rotich
and Okello (2015) and reduces maverick buying Barratt
and Rosdahl (2002), Vaidya
and Campbell (2016). Additionally, it reduces the administrative
burden on procurement officials Egorova
et al. (2021), boosting overall efficiency and
effectiveness Aboelazm
et al. (2022), Haninun
et al. (2023). A recurring theme
in the literature is the role of E-procurement in reducing corruption Fridayani
and Atmojo (2017), Aboelazm
(2022). Specifically, it reduces bid rigging Ishii
(2022), Afolabi
et al. (2022), lobbying or nepotism Said et al. (2017), favoritism Mpehle
and Mudogwa (2020), and red-tapism European
Commission (2016). It also minimizes collusion among suppliers
Mpehle
and Mudogwa (2020), Afolabi
et al. (2022) by reducing human interaction and
intermediaries like brokers Pandey
et al. (2019), thus enabling faceless procurement Lewis-Faupel
et al. (2016),Said et al. (2017). These changes decrease opportunities for
fraud Said et al. (2017), Zahra et
al. (2022) and prevent officials from subverting
processes for personal gain Campbell
(2017). It has led to
simplification of processes, which has made procurement easier to navigate Leipold
et al. (2004), Ferreira
et al. (2014), Toktaş-Palut
et al. (2014), Shakya
et al. (2015). E-procurement reduces paperwork Imtiyaj
et al. (2015), Afolabi
et al. (2022) and improves supply chain management
performance Mpehle
and Mudogwa (2020), Waithaka
and Kimani (2021). It streamlines procurement procedure for
small and medium enterprises (SMEs) thereby reducing corruption and ensuring
transparency Soong et
al. (2020). It also increases buying and selling
avenues for both buyers and suppliers Fridayani
and Atmojo (2017), Pandey
(2019) and promotes equity and inclusiveness Mpehle
and Mudogwa (2020), Sailesh
(2020) by enabling small enterprises to access
public procurement markets Bromberg
and Manoharan (2015), Pandey
(2019). This enhanced access increases competition Blum et al. (2023) and fosters communication, improving the
speed and flow of information within procurement systems Gunasekaran
and Ngai (2008), Liu et al. (2011). Real-time access to procurement systems Fridayani
and Atmojo (2017), Anthony
(2018) and the generation of reliable, persistent
data Ferreira
and Amaral (2016), Campbell
(2017) further enhance procurement record
management Boafo et
al. (2020). Špaček
and Špačková (2023) have studied the perception of employees
from central state administration bodies in Czech Republic who use the national
e-procurement system and conclude that the system has got certain benefits yet
there are numerous challenges and difficulties to make it super successful.
Despite hitches, E-procurement has emerged as a pivotal mechanism for enhancing
good governance in public procurement systems. Suardi
et al. (2025) argue that while e-procurement alone may not
directly reduce corruption, it significantly strengthens the effect of robust
procurement governance on corruption prevention. Mélon
and Spruk (2020) found that the implementation of
e-procurement reform is generally associated with a relatively stronger control
of corruption in the Netherlands and Denmark, while a similar reform in
Portugal failed to translate into a stronger control of corruption. Ratnawati
and Suryawan (2021) demonstrate that E-procurement positively
impacts good governance dimensions such as transparency, accountability, and
service quality, ultimately improving public trust. Mu’ah et al. (2024) highlight the role of E-procurement in
increasing institutional transparency and reducing collusion risks in
Indonesia. Likewise, Sirait
et al. (2023) affirm that E-procurement fosters good
governance by improving compliance, monitoring, and integrity in procurement
processes. Nasrullah
and Aven (2020) provide evidence from Tanzania that
effective E-procurement systems enhance participation, reduce delays, and
increase competition—cornerstones of good governance. Collectively, these
studies suggest that when effectively implemented and supported by sound
governance frameworks, E-procurement systems can serve as powerful tools for
good governance in emerging economies. Ofori et
al. (2023) investigated the intention to adopt the Ghana Electronic Procurement
System (GHANEPS) among public sector organizations (PSOs) in Ghana. It explored
whether two groups of procurement staff—labeled as "optimistic"
versus "discomfort"—differ significantly in their attitudes and
intentions toward using GHANEPS. While the two groups (optimistic and
discomfort) exhibited some differences in perceptions, statistical analysis
found no significant difference in their intention to adopt GHANEPS. Overall, beliefs about facilitating
conditions (e.g., support), personal innovativeness, ease of use, and perceived
usefulness were all positively linked to attitude and the intention to use the
system. Public E-Procurement in India E-procurement
systems in India have undergone substantial development over the past two
decades, marked by the pivotal launch of the Government e-Marketplace (GeM) in
2016. Imtiyaj
et al. (2015) found that E-procurement reduces
tender-related crimes, encourages healthy competition, enables 24/7 bidding,
promotes a paperless environment, and enhances process efficiency. Panduranga
(2016) emphasized that initiatives such as E-publishing, E-procurement,
DGS&D rate contracts, and GeM have bolstered transparency in public
procurement. However, challenges persist which are highlighted by Hazarika
and Jena (2017). The problems sighted were fragmented
procedures, insufficient professionals, and widespread corruption. Alryalat
et al. (2023) studied the nature of the perceived barriers
to B2G e-commerce adoption and categorized the barriers into ‘cause group’
including lack of IT infrastructure, lack of expertise and technical skills,
high cost of technology, perceived information security risk, and lack of
awareness of government issues and legal policies; and ‘effect group’ including organizational
resistance to change, lack of top management support, low perceived operational
benefits, and unwillingness to adopt B2G e-commerce services. Pai (2019) recommended GeM for fostering transparency,
accountability, and inclusiveness by opening the public procurement market.
Similarly, Pandey
(2019) observed that GeM reduces lead times,
eliminates intermediaries, ensures prompt payments, and supports
entrepreneurship. Mehra et
al. (2020) conclude that GeM portal is a relatively
novel dynamic concept and it is evolving with a mandate to revolutionize public
procurement. The success of GeM
relies heavily on its adoption by users. Nandankar
and Sachan (2019) found that performance expectancy, effort
expectancy, and trust significantly influence public buyers’ intentions to use
GeM. Gupta
(2020) compared GeM with private platforms,
emphasizing its ability to reduce human intervention, increase transparency,
and address inefficiencies in traditional procurement processes. Sailesh
(2020) underscores GeM's focus on efficiency,
transparency, and inclusiveness. Sharma
(2021) highlights persistent challenges like
insufficient IT infrastructure and staff training. Saha et al. (2025) studied the perspectives of different
stakeholders regarding the GeM and found that a few government buyers have
become dominant entities on the platform.
Dastan et al. (2025) found that GeM
platform has helped in increasing sales, benefiting from exemption from tender
fee and earnest money deposit (EMD); as agreed by 72.5% of the MSME
respondents. These studies
underline the transformative potential of E-procurement systems like GeM, while
emphasizing the need to address institutional bottlenecks and resistance to
change. Despite the technical focus of existing literature, there remains a gap
in exploring the perceptions of E-procurement among buyers and suppliers,
particularly in India. Our study seeks to address this gap by examining the
experience of GeM users on different aspects of E-procurement such as
transparency, accountability, corruption control, efficiency &
effectiveness, and ease of doing business. Theoretical Background This study is
grounded in the theoretical frameworks of the Technology Acceptance Model
(TAM), Good Governance Theory, and Public Value Theory to examine the role of
E-procurement in fostering good governance through the Government e-Marketplace
(GeM). The TAM, developed by Davis et
al. (1989), provides a lens to understand the adoption
and acceptance of technology among stakeholders, emphasizing the influence of
perceived usefulness and ease of use on user behavior. In the context of
E-procurement, TAM helps explain how procurement agencies and suppliers
perceive and adopt GeM as a tool to simplify processes, enhance efficiency, and
improve decision-making. Complementing TAM, Good Governance Theory emphasizes
the principles of transparency, accountability, efficiency, and fairness as
critical benchmarks for evaluating governance reforms. Good Governance Theory
was introduced by the World
Bank (1992) to link governance quality with development
outcomes, emphasizing transparency, accountability, and rule of law. Grindle
(2004) further conceptualized its practical application in reform efforts
within developing countries. Additionally, the Public Value Theory, as
articulated by Moore
(1995), emphasizes the creation of value for the
public through enhanced service delivery and trust in government systems. The
GeM reflects this by not only achieving cost savings and operational efficiency
but also by reinforcing citizen trust in public procurement processes. These
interrelated theoretical perspectives offer a robust foundation to explore how
public E-procurement systems like GeM contribute to enhancing governance and
generating value for stakeholders in India Methodology This study adopts
a descriptive research design to explore the dimensionality of buyer and
supplier perceptions of public E-procurement in India. The research focuses on
key governance-related variables in E-procurement identified from the extant
literature, including transparency, accountability, efficiency &
effectiveness, corruption control, and ease of doing business. These variables
have been examined to understand their role in fostering good governance
through E-procurement practices. The study specifically aims at the following
objectives: 1)
To
identify the determinants of public E-procurement adoption for good governance.
2)
To
analyze the perceptions of buyers and suppliers regarding GeM’s impact on good
governance. In this firm level
study, a purposive sampling method was employed to select respondents from the
North Indian states, including Punjab, Haryana, Himachal Pradesh, Jammu &
Kashmir, Chandigarh, and Delhi. A sample of 260 respondents was drawn including
140 suppliers and 120 buyers on the GeM platform. The selection was based on
the active participation of respondents in E-procurement processes. A self-developed interview schedule was used
to gather primary data from the respondents. The interview schedule was
designed based on an extensive literature review (see Annexure-I). The selected
items were finalized after consultation with experts in E-procurement and
public policy to ensure the content validity. Informed consent was obtained
from all participants before data collection, with assurances of anonymity and
voluntary participation throughout the study. The respondents were asked to
indicate their level of agreement with each item using a seven-point Likert
scale, ranging from "Strongly Disagree" to "Strongly
Agree." A pilot study was
conducted to evaluate the clarity and reliability of the instrument, leading to
minor revisions that enhanced the precision and relevance of the items. All
responses were collected personally by the researcher using a structured
interview schedule. As a result, the dataset was free from missing values,
eliminating the need for imputation or data cleaning procedures. To assess the
potential for common method bias, Harman’s single-factor test was conducted. We
entered all items into an unrotated principal component analysis to determine
whether a single factor would account for most of the variance. The analysis
revealed that the single factor accounted for 39.752% of the total variance,
which is below the recommended threshold of 50%. This suggests that common
method bias is not a major concern in this study. Exploratory Factor
Analysis (EFA) was conducted using Principal Component Analysis (PCA) as the
extraction method, with Varimax rotation applied. PCA is appropriate where the
primary goal is to summarize the underlying structure of a large set of variables. Factors with eigenvalues greater than 1.00
were retained, in accordance with the Kaiser criterion, to ensure inclusion of
only those components that accounted for a substantial amount of variance.
Factor loadings above 0.40 were considered significant for interpretation. In
cases of cross-loading, items were assigned to the factor on which they
exhibited the highest loading, thereby maintaining conceptual coherence and
improving the overall interpretability of the factor solution. To test the
significance of difference in the opinion of buyer and supplier groups,
independent samples t-tests were conducted on factor scores generated via
regression-weighted EFA. Analysis and Findings We applied
exploratory factor analysis on a total sample of 260 respondents including
buyers and suppliers on GeM. The KMO value of 0.948 indicates excellent
sampling adequacy, suggesting that the variables are highly interrelated and
appropriate for dimensionality reduction. Bartlett's Test of Sphericity, with
an approximate Chi-Square value of 5762.928, degrees of freedom (df) of 820,
and a significance level of 0.000, demonstrates that the correlation matrix is
not an identity matrix and that sufficient correlations exist among the
variables. These results collectively validate that the dataset meets the
requirements for conducting factor analysis effectively. Table I presents
exploratory factor analysis of perception of all the respondents regarding E-procurement
through GeM in India. Determinants of Public E-Procurement Adoption in India Based on EFA, six dimensions determine the adoption of GeM by the respondents: 1)
Transparency
and Accountability in E-Procurement: It emerges as the most important dimension explaining 39.752% of the
variance. This factor indicates that GeM has made the procurement process more
transparent and accountable by removing intermediaries, improving financial
traceability, and ensuring fair competition. It includes items like 'GeM has
improved reach across the country', 'It is easier to trace financial
transactions after implementation of GeM in procurement activity', 'GeM has led
to faceless procurement activity', 'There is elimination of middlemen in
procurement activity after introduction of GeM' and 'GeM has ensured level
playing field to all bidders'. 2)
Reduction
in Corruption and Malpractices: It is the second most important factor which explains the 4.522 %
variance. The factor reflects the role of GeM in reducing corruption by
minimizing practices such as favoritism, bid rigging, and lobbying. It creates
a fairer procurement process. It consists of items like ‘GeM has reduced
favoritism in procurement activity,’ ‘There is reduction of bid rigging after
implementation of GeM in procurement activity’, ‘There is reduction of lobbying
in procurement activity after implementation of GeM’, ‘GeM has reduced
red-tapism in procurement process.’ 3)
Improvement
in Professionalism and Fair Competition: This is another factor that explains 3.776 % of the variance. It
captures improvements in the professionalism of the procurement system and the
promotion of fair competition. The items included are 'GeM ensures fair
competition in procurement activities', 'GeM has enhanced professionalism in
public procurement,’ ‘GeM has led to reduction in scope for fraud in
procurement,’ and ‘There is increase in accuracy in procurement procedure after
implementation of GeM.’ 4)
Reliability
and Standardization: This
factor explains 3.470 % of variance. This factor captures the reliability of
information, product specifications, and the reduction of unplanned
procurement. It includes items, ‘GeM provides reliable information’, ‘GeM has
led to increase in reliability in procurement activity,’ ‘GeM has led to
reduction in unplanned procurement,’ ‘GeM provides adequate product
specifications to ensure the right product is supplied.’ 5)
Operational
Efficiency and Workload Reduction: This factor explains 3.030 % of the variance. It focuses on the
reduction of the workload and operational burdens on procurement officials. The
items included are, ‘There is availability of equal information to all
concerned after implementation of GeM,’ ‘There is reduction in the requirement
of manpower for undertaking procurement,’ ‘GeM has resulted in reduction in the
administrative burden on procurement officials’. 6)
Paperless
and Real-Time Information Access: This factor explains 2.792 % of the variance. It is characterized by a
reduction in paperwork and the availability of real-time access to information.
The items consist of, ‘There is reduction in paperwork after implementation of
GeM, and ‘GeM provides real-time access to information’. Thus, each factor
represents a different aspect of the role of E-procurement and the adoption of
GeM in enhancing good governance through improvements in transparency,
efficiency, and fairness in public procurement in India. Table 1
Factor scores were
saved for each of the dimension during the EFA. Independent samples t-tests
conducted for mean comparison of buyer and supplier perceptions across six
dimensions revealed significant group differences on three factors (see Table
II). Suppliers reported significantly stronger agreement than buyers on
Transparency and Accountability in Procurement (p = .046) and Operational
Efficiency and Workload Reduction (p = .010). In contrast, buyers expressed
significantly more favorable views than suppliers on Reliability and
Standardization (p < .001), indicating a divergent perception regarding
platform dependability and procedural consistency. No significant differences
were observed for Reduction in Corruption, Professionalism and Fair Competition,
and Paperless Real-Time Access, suggesting broadly aligned stakeholder
perceptions on those aspects. Table 2
To better
understand the perception of the buyers and the suppliers who have adopted the
GeM platform, we factor analyzed the responses of both the groups separately. For the
‘Procurement Agency/Buyer’ sample, the KMO value of 0.871 signifies a high
level of sampling adequacy, suggesting strong interrelationships among
variables. Bartlett's Test of Sphericity yields a significant result (Approx.
Chi-Square = 2561.889, df = 820, Sig. = 0.000), indicating that sufficient
correlations exist among variables to justify factor analysis. These findings
validate the appropriateness of the dataset for further factor analysis to
explore underlying constructs. Table III shows the ten unique dimensions,
emerging out of EFA of the perception of buyers about GeM. Likewise, EFA was
also conducted for the bidder/supplier category. The KMO value of 0.927
indicates strong correlations among variables and their appropriateness for
further analysis. Bartlett's Test of Sphericity, with an approximate Chi-Square
of 4115.248, degrees of freedom (df) of 820, and a significance level of 0.000,
confirms sufficient inter-variable relationships. Table IV presents the
dimensionality of perceptions of suppliers about GeM. The EFA reveals seven
distinctive factors determining the adoption of GeM by the suppliers. Impact of E-Procurement on Good Governance: Perceptions of Buyers and Suppliers Based on EFA as
shown in Table III and Table IV, we profiled a comparative picture of the
perception of procurement agencies (buyers) and bidders (suppliers). There are
many commonalities and differences in the perception of buyers and suppliers
about the impact of GeM. Both buyers and suppliers recognize the importance of
fair competition and accountability within the GeM system. Buyers (Factor 6:
Accuracy and Fair Competition) and Suppliers (Factor 1: Fair Competition and
Accountability) both agree that GeM ensures fair competition, improves
accuracy, and enhances professionalism. This indicates that both stakeholders
see GeM as contributing to good governance by establishing a level playing
field and increasing responsibility among procurement officials. Secondly, both
groups acknowledge that GeM plays a role in reducing fraud, lobbying, bid
rigging, and favoritism. Buyers (Factor 3: Transparency and Anti-Corruption
Measures) and suppliers (Factor 2: Reduction in Malpractices) perceive GeM as
reducing corruption and increasing transparency. This alignment shows that both
sides appreciate the platform's efforts to curb malpractices, which is critical
for maintaining trust in the procurement system. Thirdly, both
buyers (Factor 5: Administrative and Manpower Efficiency) and suppliers (Factor
4: Timeliness, Reliability, and Administrative Efficiency) share a common
perception of reduced administrative burden and manpower requirements due to
GeM. Both stakeholders also see improvements in workflow and reliability using
the GeM system, which simplifies processes and reduces transaction costs. Also,
both groups highlight transparency and the availability of timely and reliable
information as key benefits of GeM. For buyers (Factor 9: Real-Time and
Faceless Transactions) and suppliers (Factor 6: Expansion of Procurement
Avenues), GeM's ability to provide real-time access to information is a
significant aspect of good governance. Table 3
Table 4
We also observe
differences in perception e.g. suppliers place a stronger emphasis on market
access and buying/selling avenues (Factor 6: Expansion of Procurement Avenues),
whereas this aspect is less pronounced for buyers. Suppliers benefit from the
openness of the market created by GeM, allowing for more opportunities to
engage in procurement activities. Suppliers also
emphasize the importance of checks and balances to ensure fairness in the
selection of vendors (Factor 3: Checks and Balances). Though buyers appreciate
fairness, yet their focus is more on operational aspects. Suppliers are more
concerned with safeguards to prevent manipulation of the procurement process by
buyers. Suppliers specifically identify reductions in paperwork (Factor 5:
Paperwork and Manpower Reduction) and unplanned procurement (Factor 7:
Reduction in Unplanned Procurement) as key benefits, which may reflect their
operational priorities. For buyers, factors like workflow efficiency and
accountability (Factor 1: Workflow Efficiency and Simplification) are more
central to their perception of GeM's impact. This comparative
analysis demonstrates that while buyers and suppliers have aligned views on
many aspects of GeM, there are notable differences in their focus areas,
reflecting their unique positions within the procurement process. The
difference in the number of factors extracted for buyer respondents (10
factors) compared to suppliers (7 factors) likely arises due to differences in
the roles, responsibilities, and experiences of the buyers and the suppliers in
the procurement process. Buyers are
involved in the entire procurement process, which includes designing
procurement procedures, managing workflows, ensuring compliance, overseeing
vendor selection, and handling administrative tasks. They are responsible for
more complex and multifaceted tasks, which likely lead to the identification of
a broader range of issues and experiences, resulting in a larger number of
factors. Buyers' concerns can range from workflow efficiency and internal
accountability to managing risks such as bid rigging, favoritism, and
collusion. They are concerned with internal governance aspects of
E-procurement, leading to a more complex and varied set of factors. Suppliers, on the
other hand, are primarily focused on participation in the procurement
process—competing for bids, ensuring compliance with requirements, and
fulfilling contracts. Their experience is more focused on market access, fair
competition, openness, and receiving timely and transparent information from
the system. As a result, the suppliers' concerns and perceptions are often
simpler and more targeted. They focus more on external processes such as how
they are treated by the procurement system, whether they have a fair chance to
compete, how accessible the market is, and whether the system is transparent
and free of corruption. Their focus is less on internal workflow efficiency and
more on their interactions with the system, resulting in fewer distinct
factors. Discussion This study
investigates the role of the Government e-Marketplace (GeM) in enhancing good
governance, as perceived by buyers (procurement agencies) and suppliers
(bidders). The findings reveal that while both groups share common views on
many aspects of E-procurement, their perceptions diverge on certain priorities,
reflecting their unique roles in the procurement ecosystem. The study aligns
with the Technology Acceptance Model (TAM) by demonstrating that perceived
usefulness (e.g., transparency, accountability) and ease of use (e.g., reduced
paperwork, automation) are significant in driving GeM adoption. Buyers
emphasize GeM’s ability to streamline workflows and ensure compliance,
consistent with findings by Imtiyaj
et al. (2015) and Panduranga
(2016). Suppliers, in contrast, value fair
competition and market access, reinforcing Kassim
and Hussin,(2010) emphasis on open markets facilitated by
E-procurement. From the
perspective of Good Governance Theory, the study highlights the platform’s
success in promoting transparency, accountability, and corruption reduction.
Both buyers and suppliers acknowledge GeM’s role in mitigating favoritism,
lobbying, and bid rigging. These findings align with the literature, including
insights from Neupane
et al. (2014) and Fridayani
and Atmojo (2017), emphasizing E-procurement’s potential to
foster fairness and reduce human intervention. The study also
draws upon Public Value Theory, as GeM generates value for buyers and suppliers
by reducing costs, increasing professionalism, and expanding access. Suppliers
particularly highlight GeM's ability to improve accountability among
procurement officials and suppliers, as supported by Carter
and Bélanger (2005). Buyers, on the other hand, emphasize its
role in administrative efficiency and real-time monitoring, echoing insights
from Rotich
and Okello (2015). Despite shared
appreciation for GeM’s benefits, differences emerge. Buyers focus on internal
efficiency, accountability, and governance mechanisms, consistent with their
responsibility for compliance and decision-making. Suppliers prioritize
external aspects such as market access and competitive fairness, which reflect
their need to compete equitably. This aligns with findings from Mpehle
and Mudogwa (2020), Gupta et
al. (2020) and Saha et al. (2025), who noted the divergent priorities of
procurement stakeholders. Conclusion The study confirms
that GeM has significantly contributed to good governance by improving
transparency, accountability, and operational efficiency. Buyers perceive GeM
as a tool for optimizing workflows, ensuring compliance, and enhancing internal
accountability, while suppliers emphasize its ability to foster fair
competition, reduce malpractices, and expand market access. These findings
validate the application of TAM, Good Governance Theory, and Public Value
Theory in understanding E-procurement adoption and its governance impact. GeM
not only simplifies procurement processes but also strengthens trust among
stakeholders, fostering a culture of fairness and professionalism in public
procurement. However, the differing priorities of buyers and suppliers
highlight the need for targeted strategies to address their unique concerns. This study makes a
significant contribution by filling a critical gap in the existing literature
on public E-procurement. Although some studies have evaluated the Government
e-Marketplace (GeM) with respect to its design, benefits, and implementation
challenges (e.g., Gupta et
al. (2020), Sharma
(2021), Saha et al. (2025), they often adopt a platform-centric or
policy-oriented lens. This study departs from such approaches by empirically
examining stakeholder-specific perceptions—a relatively underexplored area.
Evaluating buyers and sellers’ perspectives separately, the study captures the
differential dimensionality of GeM adoption and its governance implications,
revealing how each stakeholder group interprets transparency, efficiency,
accountability, and market access. Unlike prior studies that treat GeM users as
a homogenous group, this research offers a comparative, evidence-based insight
into the platform’s performance. This study generates and adds a user-level
understanding to the academic discourse on digital procurement in India. Our study offers
actionable insights for policymakers seeking to enhance governance through
digital procurement reforms in India. The findings affirm that the Government
e-Marketplace in India significantly contributes to good governance by
enhancing transparency, accountability, operational efficiency, and fairness in
public procurement. Policies that prioritize the scaling of GeM adoption,
backed by structured training programs for procurement officials, can further
institutionalize the gains achieved in reducing malpractices, minimizing human
intervention, and promoting fair competition. Additionally, the differentiated
perceptions of buyers and suppliers highlight the need for policies that
address user-specific challenges. For instance, policies could focus on
expanding digital infrastructure and providing targeted support to suppliers,
particularly MSMEs, to improve their access and competitiveness on GeM. For practitioners,
this study highlights the tangible benefits of GeM in simplifying procurement
workflows, reducing paperwork, and enhancing the accuracy and transparency of
procurement processes. Procurement officials can leverage GeM to automate routine
tasks, thereby reallocating time toward strategic procurement planning and
supplier management, which contributes to improving service delivery and
operational effectiveness. Suppliers, particularly MSMEs, can use the
transparency and openness of GeM to compete on a level playing field, expanding
their market reach, and reducing the dependency on intermediaries. Managers can
also benefit from real-time data and reliable information provided by GeM to
make informed procurement decisions, improve supply chain performance, and
foster professionalism within procurement teams. While the study
offers valuable insights, we do not claim generalization of the results. The sample is limited to North Indian states,
which may not capture regional variations in GeM adoption and perception.
Future research may extend this analysis to other regions or sectors to enhance
generalizability. Secondly, understanding the barriers faced by non-users or
reluctant adopters could offer critical feedback for platform design, training,
and policy outreach. Expanding the evidence base through broader, more
randomized national studies will be essential for refining procurement reforms
and building a truly inclusive digital governance ecosystem. Exploring the
long-term impact of GeM on procurement efficiency and governance outcomes would
also be valuable. Further studies may investigate the role of training and
capacity building in enhancing platform adoption and satisfaction among both
buyers and suppliers. In a developing
country context, this study highlights the transformative potential of
E-procurement systems like GeM in institutionalizing transparency, efficiency,
and trust in public administration. By capturing the voices of both buyers and
suppliers, this study contributes actionable insights to improve implementation
and scale-up strategies for digital procurement reforms in India and similar
governance environments globally. Countries seeking to modernize their public
procurement systems can draw from India’s experience with GeM to design
stakeholder-inclusive platforms that align with governance priorities. ACKNOWLEDGMENTS None. REFERENCES Aboelazm, K.S. (2022), E-Procurement in the International Experience: An Approach to Reduce Corruption in Administrative Contracts in Egypt", International Journal of Procurement Management, 15(3), 340–364. DOI: https://doi.org/10.1504/ijpm.2021.10038473 Afolabi, A., Ibem, E., Aduwo, E. and Tunji-Olayeni, P. (2022), Digitizing the Grey Areas in the Nigerian Public Procurement System Using E-Procurement Technologies, International Journal of Construction Management, 22(12), 2215–2224. DOI: https://doi.org/10.1080/15623599.2020.1774836 Alryalat, M.A.A., Alryalat, H., Alhamzi, K.H. and Sharma, A. (2023), Perceived Barriers to Business-to-Government (B2G) E-Commerce Adoption: The Case of Government E-Marketplace (GeM) Portal in India", International Journal of Electronic Government Research (IJEGR), 19 (1), 1-19. Anthony, A. (2018), The use of E-Procurement in South African Public Procurement law: Challenges and Prospects, Law, Democracy & Development, 22 (1), 39–47. DOI: https://doi.org/10.4314/ldd.v22i1.4 Barratt, M. and Rosdahl, K. (2002), Exploring Business-To-Business Marketsites, European Journal of Purchasing & Supply Management, 8 (2), 111–122. DOI: https://doi.org/10.1016/s0969-7012(01)00010-7 Belisari, S., Appolloni, A. and Cerruti, C. (2019), Positive and Negative Impacts of the Adoption of E-Procurement Solutions: The Italian Market Case", International Journal of Procurement Management, 12(2), 219–241. DOI: https://doi.org/10.1504/ijpm.2019.098553 Blum, J.R., Datta, A., Fazekas, M., Samaddar, S. and Siddique, I. (2023), Introducing E-Procurement in Bangladesh. The Promise of Efficiency and Openness, World Bank Working Paper, The World Bank, Washington, DC. Boafo, N.D., Ahudey, E. and Darteh, A.O. (2020), Evaluating E-Procurement Impact in the Public Sector, Archives of Business Review, 8 (5), 235–247. DOI: https://doi.org/10.14738/abr.85.8268 Brandon-Jones, A. (2017), E-Procurement Quality from an Internal Customer Perspective: Construct Development, Refinement, and Replication Using a Mixed-Methods Approach", International Journal of Operations & Production Management, 37(12), 1741–1772. DOI: https://doi.org/10.1108/ijopm-08-2016-0480 Bromberg, D. and Manoharan, A. (2015), E-procurement Implementation in the United States: Understanding Progress in Local Government, Public Administration Quarterly, 39(3), 360–392. DOI: https://doi.org/10.1177/073491491503900301 Campbell, J.W. (2017), Public Procurement Policy in South Korea: Approaches to Sustainable Development and Anti-Corruption", The Experience of Democracy and Bureaucracy in South Korea, 28, 159–179, Emerald Publishing Limited. DOI: https://doi.org/10.1108/s2053-769720170000028007 Carter, L. and Bélanger, F. (2005), The Utilization of E-Government Services: Citizen Trust, Innovation, and Acceptance Factors, Information Systems Journal, 15(1), 5–25. DOI: https://doi.org/10.1111/j.1365-2575.2005.00183.x Croom, S. R., and Brandon-Jones, A. (2005). Key Issues in E-Procurement: Procurement Implementation and Operation in the Public Sector. Journal of Public procurement, 5(3), 367-387.DOI: https://doi.org/10.1108/JOPP-05-03-2005-B004 Croom, S. and Brandon-Jones, A. (2007), Impact of E-Procurement: Experiences from Implementation in the UK Public Sector", Journal of Purchasing and Supply Management, 13(4), 294–303. DOI: https://doi.org/10.1016/j.pursup.2007.09.015 Dastan, L. C., Jegatha, K., and Kumar, V. B. (2025), Role of GeM (Government E-Marketplace) Gateway in Empowering MSMEs in Public Procurement", ICTACT Journal of Management Studies, Vol. 11, No.1, pp. 2062 – 2067. DOI: 10.21917/ijms.2025.0319 Davis, F.D. (1989), Perceived Usefulness, Perceived Ease of use, and user Acceptance of Information technology", MIS Quarterly, 13 (3), 319–340. DOI: https://doi.org/10.2307/249008 Dooley, K. and Purchase, S. (2006), Factors Influencing E-Procurement Usage”, Journal of Public Procurement, Vol.6(1/2), 28–45. Egorova, M., Andreeva, L., Andreev, V., Tsindeliani, I. and Kikavets, V. (2021), "Digitalization of Public Procurement in the Russian Federation: Case study", NISPAcee Journal of Public Administration and Policy, 14 (1),87–106. DOI: https://doi.org/10.2478/nispa-2021-0004 European Commission (2016), EU public Procurement Reform: Less Bureaucracy, Higher Efficiency, Available at: https://ec.europa.eu/docsroom/documents/16412 Ferreira, I. and Amaral, L.A. (2016), Public E-Procurement: Advantages, Limitations, and Technological “Pitfalls”, Proceedings of the 9th International Conference on Theory and Practice of Electronic Governance, 9–12. DOI: https://doi.org/10.1145/2910019.2910089 Ferreira, I., Cunha, S., Amaral, L.A. and Camões, P. (2014). ICT for Governance in Combating Corruption: The Case of Public E-Procurement in Portugal", Proceedings of the 8th International Conference on Theory and Practice of Electronic Governance, 109–112. DOI: https://doi.org/10.1145/2691195.2691265 Fridayani, H.D. and Atmojo, M.E. (2017). The Implications of Openness in Electronic Procurement in East Kalimantan in 2011–2015", Social and Political Issues in Asia: In the Context of Global Changes, 67-86. Buku Litera: Yogyakarta, Indonesia. Grindle, M. S. (2004). Good Enough Governance: Poverty Reduction and Reform in developing countries”, Governance, 17 (4), 525-548. DOI: https://doi.org/10.1111/j.0952-1895.2004.00256.x Gunasekaran, A. and Ngai, E.W. (2008), Adoption of E-Procurement in Hong Kong: An Empirical Research", International Journal of Production Economics, Vol. 113 No. 1, pp. 159–175. DOI: https://doi.org/10.1016/j.ijpe.2007.04.012 Gupta, M. (2020). Government e-Marketplace, GeM, Indian Institute of Management Bangalore. Available at: https://repository.iimb.ac.in/handle/2074/19600 Haninun, H., Danescan, M., Pratito, A., Simanjuntak, E.T.Y., Dwiputri, N.K.W. and Novita, T. (2023). "Public Accountability in Electronic Procurement of Government Goods and Services (E-Procurement) in Local Governments", Journal Science Administration, Innovations, and Public Service Development, 1 (1), 1–19, https://journal.ubl.ac.id/index.php/j-administration/article/view/30/17 Hazarika, B. and Jena, P.R. (2017). Public Procurement in India: Assessment of Institutional Mechanism, Challenges, and reforms", National Institute of Public Finance and Policy, 2(1), 42–57, Imtiyaj, S., Biswal, N.R., Ray, T.P. and Hota, D.A. (2015). "An in-depth Understanding of E-Procurement: A Case Study Approach", IOSR Journal of Computer Engineering (IOSR-JCE), 17(6), 20–24. Intauno, K., Chilunjika, A. and Poshai, L. (2024). Electronic procurement Adoption in Zimbabwe's public sector: Examining the Benefits, Shortcomings, and critical success factors", International Journal of Project Management, 20(3), 331–349. DOI: https://doi.org/10.1504/IJPM.2024.138963 Ishii, R. (2022). "Can E-Procurement Reduce Bid Rigging in Public Auctions?” Journal of Competition Law & Economics, 18 (2), 456–482. DOI: https://doi.org/10.1093/joclec/nhab019 Kameshwaran, S., Narahari, Y., Rosa, C.H., Kulkarni, D.M. and Tew, J.D. (2007). "Multiattribute Electronic Procurement Using Goal Programming, European Journal of Operational Research, 179 (2), 518–536. DOI: https://doi.org/10.1016/j.ejor.2006.01.010 Kassim, E.S. and Hussin, H. (2010). "Public E-Procurement: A Research synthesis", 2010 International Conference on e-Education, e-Business, e-Management, and e-Learning, IEEE Computer Society, 150–154. DOI: https://doi.org/10.1109/ic4e.2010.93 Leipold, K., Klemow, J., Holloway, F., and Vaidya, K. (2004). The World Bank E-Procurement for the Selection of Consultants: Challenges and Lessons Learned,” Journal of Public Procurement, 4 (3), 319-339. DOI: https://doi.org/10.1108/JOPP-04-03-2004-B001 Lewis-Faupel, S., Neggers, Y., Olken, B.A. and Pande, R. (2016). Can Electronic Procurement Improve Infrastructure Provision? Evidence from Public Works in India and Indonesia", American Economic Journal: Economic Policy, 8(3),258–283. DOI: https://doi.org/10.1257/pol.20140258 Liu, Q., Sun, S.X., Wang, H. and Zhao, J. (2011). A Multi-Agent-Based System for E-Procurement Exception Management", Knowledge-Based Systems, 24 (1),49–57. DOI: https://doi.org/10.1016/j.knosys.2010.07.004 Mehra, A., Sharma, S. and Koushal, V. (2020). Implementation of Government E-Marketplace in a Tertiary Care Hospital of North India: Advantages and challenges”, International Journal of Research in Medical Sciences, 8 (11), 3934-3937. DOI: https://dx.doi.org/10.18203/2320-6012.ijrms20204881 Moon, M. J. (2005), E-procurement Management in State Governments: Diffusion of E-Procurement Practices and its Determinants, Journal of Public Procurement, 5 (1), 54-72. DOI: https://doi.org/10.1108/JOPP-05-01-2005-B003 Moore, M.H. (1995), Creating Public Value: Strategic Management in Government, Cambridge, MA: Harvard University Press. Mpehle, Z. and Mudogwa, R.M. (2020). Utilisation of Digital Central Supplier Database in Enabling Electronic Procurement in the Limpopo Provincial departments", Africa’s Public Service Delivery and Performance Review, 8 (1), 1–10. DOI: https://doi.org/10.4102/apsdpr.v8i1.356 Mu’ah, M., Masram, M., Amalia, W., Sayyid, M., and Mas’adah, M. (2024). “Pengaruh Implementasi E-Procurement Terhadap Fraud Pengadaan Barang Dan Jasa Dalam Mewujudkan Good Governance”, Owner: Riset Dan Jurnal Akuntansi, 8(2), 1810-1822. DOI: https://doi.org/10.33395/owner.v8i2.2065 Mélon, L., and Spruk, R. (2020). The Impact of E-Procurement on Institutional Quality”, Journal of Public Procurement, 20 (4),333-375. DOI: https://doi.org/10.1108/JOPP-07-2019-0050 Nandankar, N. and Sachan, A. (2019). Adoption of Government E-Marketplace (GeM) in Indian Government Sector, POMS International Conference, Mumbai, India. Nasrullah and Aven, G. S. (2020). The Effectiveness of E-Procurement in Realizing Good Governance in the Regency of Kampar”, in the 2nd International Conference of Law, Government and Social Justice (ICOLGAS 2020) (701-710). Atlantis Press. DOI: 10.2991/assehr.k.201209.354 Neupane, A., Soar, J. and Vaidya, K. (2014). "An Empirical Evaluation of the Potential of Public E-Procurement to Reduce Corruption", Australasian Journal of Information Systems, 18 (2), 21–44. DOI: https://doi.org/10.3127/ajis.v18i2.780 Ofori, D., Light, O., and Ankomah, J. (2023). Adoption Intentions of Electronic Procurement Among Public Sector Organisations (PSOs) in Ghana: emerging economy perspective”, Journal of Public Procurement, 23(2), 179-199. DOI: https://doi.org/10.1108/JOPP-09-2022-0045 Pai, D. (2019). Government E-Marketplace: A Gem of an idea", Journal of Emerging Technologies and Innovative Research (JETIR), 6(4), 192–196, available at: http://www.jetir.org/papers/JETIRBH06027 Pandey,
C. (2019).
Digital vs. Physical Procurement: Role of GeM in transforming B2G procurement
in India", The Business & Management Review, Vol. 10 No. 5, p. 151. Panduranga, V. (2016). "Transparency in Public Procurement through E-Procurement in India", Journal of Internet Banking and Commerce, 21(3), 1–7. Ratnawati, N. L. T. T., and Suryawan, I. M. Y. (2021). E-Procurement Implementation as Reflection of Good Governance in North Lombok Regency”, Journal of Humanities, Social Science, Public Administration and Management, 1 (1), 8-14. DOI: https://doi.org/10.0121/husocpument.v1i1.3 Rotich, G.K. and Okello, B. (2015). "Analysis of use of E-Procurement on performance of the Procurement Functions of County Governments in Kenya", International Journal of Economics, Commerce and Management, 3 (6),1381–1398. Saha, D., Singh, T., Maheshwari, G., Arora, K., Kartik, and Kapoor, K. (2025). “On Recent Advances in Public Procurement: An Exploration of the Government E-Marketplace in India”, Public Administration and Development, DOI: https://doi.org/10.1002/pad.2113 Said,
J., Ishak, M.W. and Omar, N. (2017). The Effectiveness of E-Procurement Systems
in Reducing Lobbyist Involvement in Public Procurement, Asia-Pacific Management
Accounting Journal (APMAJ), 12 (1), 1–27. Sailesh,
M. (2020). Study
on Government e-Marketplace (GeM) – Shift to digital buying and paperless
contracts, Indian Institute of Management, Ahmedabad. Shakya, R.K. (2015). Good Governance in Public Procurement: An Evaluation of the role of an E-Procurement system, [Doctoral dissertation, Capella University]. Sharma, R. (2021). Electronic procurement and its Implementation in Indian industries", Turkish Journal of Computer and Mathematics Education (TURCOMAT), 12(9), 892–896. http://turcomat.org/index.php/turkbilmat/article/view/3315 Singer, M., Konstantinidis, G., Roubik, E., and Beffermann, E. (2009). Does E-Procurement Save the State Money? Journal of Public Procurement,9(1), 58-78. DOI: https://doi.org/10.1108/JOPP-09-01-2009-B002 Singh, P. and Vij, S. (2022), Dynamics of E-Procurement: A Review of Literature and Directions for Future Research", in Dynamics of Management in a Digital World, 177–215, Seema Sahitya Bhawan. DOI: https://doi.org/10.5281/zenodo.14524663 Sirait, D. M., Salsabila, L., Dompak, T., and Lodan, K. T. (2023). Realizing Good Governance through the Implementation of Electronic Procurement Services (LPSE) in Batam City”, in Conference on Business, Social Sciences and Technology (CoNeScINTech), 3(1),135-143. Available at: https://journal.uib.ac.id/index.php/conescintech Siwandeti, M., Sanga, C. and Panga, F. (2023). Perceived Benefits of Participation in Public Electronic Procurement: A Comparative Analysis of Vendors in Ilala District, Tanzania, Journal of Co-operative and Business Studies (JCBS), 6(1). DOI: https://doi.org/10.1007/978-3-030-68836-3_38 Soong, K. K., Ahmed, E. M., & Tan, K. S. (2020). Factors influencing Malaysian Small and Medium Enterprises Adoption of Electronic Government Procurement. Journal of Public Procurement, 20(1), 38-61. DOI: https://doi.org/10.1108/JOPP-09-2019-0066 Suardi, I., Rossieta, H., Diyanty, V., and Djakman, C. (2025), Moderating the Effect of Procurement Governance on Corruption Through E-Procurement”, Integritas: Jurnal Antikorupsi, 11(1), 53-66. DOI: https://doi.org/10.32697/integritas.v11i1.1462 Toktaş-Palut, P., Baylav, E., Teoman, S. and Altunbey, M. (2014). The Impact of Barriers and Benefits of E-Procurement on its Adoption Decision: An Empirical analysis", International Journal of Production Economics, 158, 77–90. DOI: https://doi.org/10.1016/j.ijpe.2014.07.017 Vaidya, K. and Campbell, J. (2016). Multidisciplinary Approach to Defining Public E-Procurement and Evaluating its Impact on Procurement Efficiency", Information Systems Frontiers, 18 (2), 333–348. DOI: https://doi.org/10.1007/s10796-014-9536-z Waithaka, R.K. and Kimani, J.G. (2021). Effect of E-Procurement Practices on Supply Chain Performance", Global Journal of Purchasing and Procurement Management, 1(1), 32–42. DOI: https://doi.org/10.47604/gjppm.1200 World Bank (1992). Governance and Development. Washington, DC: World Bank. DOI: http://documents.worldbank.org/curated/en/604951468739447676 Zahra, F., Abdullah, M., Din, M., Thahir, H., Harun, H. and Ali, J. (2022). The Role of E-Purchasing in Government Procurement Fraud Reduction Through Expanding market access", International Journal of Data and Network Science, 6 (1),179–184. DOI: https://doi.org/10.5267/j.ijdns.2021.9.010 Špaček, D., and Špačková, Z. (2023). Issues of E-Government Services Quality in the Digital-By-Default Era–The Case of the National E-Procurement Platform in Czechia”, Journal of Public Procurement, Vol.23 No.1, pp.1-34. DOI: https://doi.org/10.1108/JOPP-02-2022-0004 Annexure-I
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||