{"id":539120,"date":"2025-03-21T07:38:32","date_gmt":"2025-03-21T07:38:32","guid":{"rendered":"https:\/\/www.capgemini.com\/au-en\/?p=539120&#038;preview=true&#038;preview_id=539120"},"modified":"2025-03-28T15:47:54","modified_gmt":"2025-03-28T15:47:54","slug":"question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach","status":"publish","type":"post","link":"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/","title":{"rendered":"Question-Answer Generation (QAG) for automated summarization evaluation: A reference-free approach"},"content":{"rendered":"\n<header class=\"wp-block-cg-blocks-hero-blogs header-hero-blogs\"><div class=\"container\"><div class=\"hero-blogs\"><div class=\"hero-blogs-content-wrapper\"><div class=\"row\"><div class=\"col-12\"><div class=\"header-title\"><h1>Question-Answer Generation (QAG) for automated summarization evaluation: A reference-free approach<\/h1><\/div><\/div><\/div><\/div><div class=\"hero-blogs-bottom\"><div class=\"header-author\"><div class=\"author-img\"><img decoding=\"async\" src=\"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/SRon-Headshot1.png?w=200&amp;quality=10\" alt=\"\" loading=\"lazy\"\/><\/div><div class=\"author-name-date\"><h5 class=\"author-name\">Sangeeta Ron<\/h5><h5 class=\"blog-date\">21 Mar 2025<\/h5><\/div><\/div><div class=\"brand-image\"> <\/div><\/div><\/div><\/div><\/header>\n\n\n\n<section class=\"wp-block-cg-blocks-group undefined section section--article-content\"><div class=\"article-main-content\"><div class=\"container\"><div class=\"row\"><div class=\"col-12 col-md-1\"><nav class=\"article-social\"><ul class=\"social-nav\"><li class=\"ip-order-fb\"><a href=\"https:\/\/www.facebook.com\/sharer\/sharer.php?=http:\/\/capgeminiucwe.develop\/?post_type=press-release&amp;p=179\" target=\"_blank\" rel=\"noopener noreferrer\" title=\"opens in a new window\"><i aria-hidden=\"true\" class=\"icon-fb\"><\/i><span class=\"sr-only\">Facebook<\/span><\/a><\/li><li class=\"ip-order-tw\"><a href=\"https:\/\/twitter.com\/intent\/tweet?=http:\/\/capgeminiucwe.develop\/?post_type=press-release&amp;p=179\" target=\"_blank\" rel=\"noopener noreferrer\" title=\"opens in a new window\"><i aria-hidden=\"true\" class=\"icon-tw\"><\/i><span class=\"sr-only\">Twitter<\/span><\/a><\/li><li class=\"ip-order-li\"><a href=\"https:\/\/www.linkedin.com\/shareArticle?=http:\/\/capgeminiucwe.develop\/?post_type=press-release&amp;p=179\" target=\"_blank\" rel=\"noopener noreferrer\" title=\"opens in a new window\"><i aria-hidden=\"true\" class=\"icon-li\"><\/i><span class=\"sr-only\">Linkedin<\/span><\/a><\/li><\/ul><\/nav><\/div><div class=\"col-12 col-md-11 col-lg-10\"><div class=\"article-text article-quote-text\">\n<h2 class=\"wp-block-heading\" id=\"h-the-challenge-of-text-summarization-in-financial-services\">The challenge of text summarization in financial services<\/h2>\n\n\n\n<p>The financial services industry generates an immense volume of documentation daily. From customer interactions and regulatory filings to legal proceedings and risk assessments, organizations must process, interpret, and act upon large amounts of unstructured data. Traditionally, this has been a time-consuming and labor-intensive process, often susceptible to human error and inconsistencies. As regulatory frameworks evolve and customer expectations rise, the demand for accurate, efficient, and standardized document summarization has never been more critical.<\/p>\n\n\n\n<p>In banking, institutions must navigate a constantly shifting regulatory landscape. Compliance teams are responsible for reviewing extensive regulatory filings, risk reports, and audit documents\u2014any misinterpretation can result in significant financial and legal consequences. Beyond compliance, customer service operations require rapid access to key insights from call center interactions to enhance service efficiency. Additionally, loan and credit risk assessment teams manually analyze financial statements, credit histories, and other documents to determine creditworthiness, a process that is both time-intensive and costly.<\/p>\n\n\n\n<p>The insurance sector faces similar challenges, particularly in underwriting, policy management, and claims processing. Insurance providers must constantly interpret complex regulatory changes while ensuring accurate policy underwriting and risk assessment. Claims processing teams review medical reports, legal documents, and third-party assessments to determine coverage and fraud risk. Manual document reviews in these areas not only slow down operations but also introduce inconsistencies that can impact decision-making.<\/p>\n\n\n\n<p>The increasing complexity of financial services documentation makes manual summarization an unsustainable approach. Generative AI (GenAI) offers a powerful solution by enabling automated summarization of key insights from various documents. However, assessing the quality of AI-generated summaries remains a challenge. Traditional evaluation methods, such as <a href=\"https:\/\/aclanthology.org\/W04-1013.pdf\" target=\"_blank\" rel=\"noreferrer noopener\">ROUGE<\/a> and <a href=\"https:\/\/arxiv.org\/pdf\/1904.09675\" target=\"_blank\" rel=\"noreferrer noopener\">BERTScore<\/a>, rely on human-generated references, which are not always available or practical for large-scale financial services applications.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-introducing-qag-based-automated-summarization-evaluation\">Introducing QAG-based automated summarization evaluation<\/h2>\n\n\n\n<p>Question-Answer Generation (QAG) for <a href=\"https:\/\/docs.confident-ai.com\/docs\/metrics-summarization\" target=\"_blank\" rel=\"noreferrer noopener\">automated summarization evaluation<\/a> provides a breakthrough, offering a reference-free approach to ensuring both completeness and accuracy in AI-generated summaries. Instead of comparing summaries to predefined references, QAG-based evaluation gauges summarization quality by generating factual questions from the original document and checking whether the AI-generated summary provides correct answers.<\/p>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" src=\"https:\/\/www.capgemini.com\/wp-content\/uploads\/2025\/03\/image_267daf.png?w=950\" alt=\"\" class=\"wp-image-1112188\"\/><\/figure>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-experimental-results\"><strong>Experimental results<\/strong><\/h4>\n\n\n\n<p>Optimization techniques for QAG were implemented that included limiting truth extraction and using custom question templates to improve evaluation performance.<\/p>\n\n\n\n<p>This enhanced QAG-based evaluation approach was then tested on four real-world transcripts. In each test, both the default QAG model and our optimized approach were implemented. The following table summarizes the results:<\/p>\n\n\n\n<figure class=\"wp-block-image size-full\"><img decoding=\"async\" src=\"https:\/\/www.capgemini.com\/wp-content\/uploads\/2025\/03\/image_ff109a.png\" alt=\"\" class=\"wp-image-1112191\"\/><\/figure>\n\n\n\n<p>Overall, the experimental results reveal a significant leap in alignment scores, rising from a baseline of 56% to over 70%, while coverage scores experienced an even greater boost, increasing from 70% to 90%. These enhancements demonstrate the effectiveness of the refined approach in producing more accurate and comprehensive AI-generated summaries.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-wide-ranging-use-cases-in-banking-and-insurance\">Wide-ranging use cases in banking and insurance<\/h2>\n\n\n\n<p>By implementing QAG-based evaluation, financial institutions can improve the reliability and accuracy of GenAI-powered summarization across multiple business functions. In banking, it ensures that compliance reports, customer interactions, and financial risk assessments maintain factual integrity. In insurance, it enhances underwriting decisions, policy management, and claim evaluations. The following is a sample of several key use cases in financial services.<\/p>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-banking-use-cases\"><strong>Banking use cases<\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Call center interaction summarization:<\/strong> Customer service teams manage a high volume of customer interactions, often recorded in call center transcripts, chat logs, and emails. GenAI can summarize these conversations, extracting key themes, customer concerns, and sentiment trends, enabling more efficient issue resolution. With QAG-based evaluation, AI-generated summaries ensure that no critical customer concerns are overlooked, allowing for more personalized and proactive customer support.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Audit report summarization:<\/strong> Internal audits are a critical part of risk management in banking, yet the process is often time-consuming and labor-intensive. AI-powered summarization helps highlight key discrepancies, compliance violations, and recommended actions from audit reports, improving the efficiency of risk and compliance teams. With QAG-based evaluation, banks can ensure that summarized audit findings remain aligned with the original reports, reducing the chances of oversight in risk assessments.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Credit risk assessment:<\/strong> Evaluating a borrower\u2019s financial health requires the review of credit reports, financial statements, and loan histories, often spread across multiple documents. GenAI can consolidate key financial indicators into a structured summary, allowing risk analysts to make faster and more informed lending decisions. By applying QAG-based evaluation, banks can verify that these summaries accurately reflect the borrower\u2019s financial status, reducing errors in credit risk assessments.<\/li>\n<\/ul>\n\n\n\n<h4 class=\"wp-block-heading\" id=\"h-insurance-use-cases\"><strong>Insurance use cases<\/strong><\/h4>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Underwriting and risk assessment:<\/strong> Insurance underwriting requires the evaluation of extensive data, including health records, financial documents, and previous policy claims. GenAI-generated summaries allow underwriters to quickly assess risk factors, policy eligibility, and pricing considerations. With QAG-based evaluation, insurers can confirm that these summaries capture the full scope of risk assessment criteria, reducing underwriting errors and improving decision-making efficiency.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Policy management: <\/strong>Managing policies involves handling a large amount of unstructured documentation throughout the policy lifecycle. Any modifications initiated by insurers or customers require careful reassessment. GenAI streamlines this process by efficiently condensing information from various sources. By applying QAG-based evaluation, insurers can confirm that AI-generated summaries align with policy terms and regulatory requirements, enabling them to allocate more time to strategic tasks such as customer service and relationship management.<\/li>\n<\/ul>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>Claims processing:<\/strong> Whether for auto, healthcare, or commercial policies, claims processing is a complex, documentation-heavy task that demands significant time and effort when done manually. GenAI automates the extraction of critical details from diverse records. QAG-based evaluation ensures that all necessary claim details are preserved, reducing operational costs, expediting claim settlements, and improving overall customer satisfaction.<\/li>\n<\/ul>\n\n\n\n<p>These use cases highlight just a few of the many ways QAG-based evaluation can be applied in financial services. Potential applications extend far beyond these examples. Depending on an organization\u2019s specific needs, QAG-based evaluation can be adapted to review AI-generated summaries across a wide range of business functions, including regulatory reporting, contract analysis, investment research, internal policy compliance, and more.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-driving-accuracy-efficiency-and-trust-in-ai-generated-summarization\">Driving accuracy, efficiency, and trust in AI-generated summarization<\/h2>\n\n\n\n<p>As financial institutions increasingly rely on GenAI to streamline document processing, ensuring the accuracy and reliability of AI-generated summaries is paramount. QAG-based automated summarization evaluation provides a reference-free, scalable, and precise method to assess summarization quality, addressing one of the key challenges in AI adoption. By evaluating summaries based on factual correctness and content coverage, QAG-based evaluation offers a structured approach to verifying AI outputs without the need for human-generated reference summaries.<\/p>\n\n\n\n<p>The benefits of integrating this approach in banking and insurance are far-reaching. Banks can enhance decision-making by quickly extracting key insights from financial reports, compliance documents, and customer interactions. This leads to faster responses to regulatory changes, improved operational efficiency, and a more seamless customer experience. In the insurance sector, QAG-based evaluation improves underwriting accuracy and claims processing efficiency, ensuring that AI-generated summaries are both comprehensive and aligned with business objectives. &nbsp;<\/p>\n\n\n\n<p>Now is the time for financial institutions to embrace AI-powered summarization with QAG-based evaluation. To explore how this approach can elevate your organization\u2019s AI-driven summarization efforts, contact Capgemini\u2019s Financial Services Insights &amp; Data team today.&nbsp;&nbsp;<\/p>\n<\/div><\/div><\/div><\/div><\/div><\/section>\n\n\n\n<section class=\"wp-block-cg-blocks-wrapper-people-slider section section--expert-slider wrapper-people-slider undefined\"><div class=\"container\"><div class=\"content-title\"><h2 data-maxlength=\"34\" class=\"people-heading-title\">Author<\/h2><\/div><\/div><div class=\"slider slider-boxed\"><div class=\"container\"><div class=\"slider-window\"><div class=\"slider-list\">\t\t<div class=\"slide\">\n\t\t\t<div class=\"box\">\n\t\t\t\t<div class=\"row\">\n\t\t\t\t\t<div class=\"col-md-6 col-lg-4 box-img-wrapper\">\n\t\t\t\t\t\t<img decoding=\"async\" loading=\"lazy\" src=\"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/SRon-Headshot1.png\" alt=\"Sangeeta Ron\"\/>\n\t\t\t\t\t<\/div>\n\t\t\t\t\t<div class=\"col-md-6 col-lg-8 box-inner\">\n\t\t\t\t\t\t<div class=\"row title-social-media-header\">\n\t\t\t\t\t\t\t<div class=\"col-md-12 col-lg-6 mbl-social-icon\">\n\t\t\t\t\t\t\t\t<ul class=\"social-nav\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<li>\n\t\t\t\t\t\t\t\t\t\t\t<a class=\"subnav-button--form\" href=\"javascript:void(0)\" aria-label=\"contact us\" data-bs-toggle=\"modal\" data-bs-target=\"#WPBca98714e_6919_4e03_aca0_c8070bb2d624\" data-bs-expert-title=\"1\">\n\t\t\t\t\t\t\t\t\t\t\t\t<i aria-hidden=\"true\" class=\"ico-form\"><\/i>\n\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/ul>\n\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<div class=\"col-md-12 col-lg-6 box-container\">\n\t\t\t\t\t\t\t\t<div class=\"box-title\">\n\t\t\t\t\t\t\t\t\t<h3 class=\"people-profile-title\">Sangeeta Ron<\/h3>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<span>Senior Director, Financial Services Insights &amp; Data<\/span>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<div class=\"col-md-12 col-lg-6 social-box-container dkt-social-icon\">\n\t\t\t\t\t\t\t\t<ul class=\"social-nav\">\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<li>\n\t\t\t\t\t\t\t\t\t\t\t<a class=\"subnav-button--form\" href=\"javascript:void(0)\" aria-label=\"contact us\" data-bs-toggle=\"modal\" data-bs-target=\"#WPBca98714e_6919_4e03_aca0_c8070bb2d624\" data-bs-expert-title=\"Sangeeta Ron\">\n\t\t\t\t\t\t\t\t\t\t\t\t<i aria-hidden=\"true\" class=\"ico-form\"><\/i>\n\t\t\t\t\t\t\t\t\t\t\t<\/a>\n\t\t\t\t\t\t\t\t\t\t<\/li>\n\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t\t<\/ul>\n\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t\t\t\t\t\t<div class=\"modal\" id=\"WPBca98714e_6919_4e03_aca0_c8070bb2d624\">\n\t\t\t\t\t<div class=\"modal-dialog modal-dialog-centered modal-lg modal-dialog-scrollable landing-page-modals\">\n\t\t\t\t\t\t<div class=\"modal-content\">\n\t\t\t\t\t\t\t<div class=\"modal-header\">\n\t\t\t\t\t\t\t\t<button type=\"button\" class=\"btn-close\" aria-label=\"close\" data-bs-dismiss=\"modal\"><\/button>\n\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t\t<div class=\"modal-body\">\n\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t\t\t\t\t<div class=\"mf_forms__container \">\n\t\t\t\t\t\t\t\t<form id=\"mf_form_127840_1608045628\" class=\"mf_form__form row needs-validation\" action=\"\" method=\"post\" enctype=\"multipart\/form-data\" data-nosnippet>\n\n\t\t\t\t<div class=\"mf-field-wrapper form-floating col-sm-12\"><input type=\"text\" class=\"form-control\" id=\"_mf_127840_7235_8892913\" name=\"_mf_127840_7235\" placeholder=\"First Name\" required \/><label for=\"_mf_127840_7235_8892913\" class=\"form-label\">First Name <span class=\"star-required\">*<\/span><\/label><div class=\"invalid-feedback-frm\" role=\"alert\">First Name is not valid.<\/div><\/div><div class=\"mf-field-wrapper form-floating col-sm-12\"><input type=\"text\" class=\"form-control\" id=\"_mf_127840_9041_305165344\" name=\"_mf_127840_9041\" placeholder=\"Last Name\" required \/><label for=\"_mf_127840_9041_305165344\" class=\"form-label\">Last Name <span class=\"star-required\">*<\/span><\/label><div class=\"invalid-feedback-frm\" role=\"alert\">Last Name is not valid.<\/div><\/div><div class=\"mf-field-wrapper form-floating col-sm-12\"><input type=\"email\" class=\"form-control\" id=\"_mf_127840_2885_162515911\" name=\"_mf_127840_2885\" placeholder=\"Email\" required \/><label for=\"_mf_127840_2885_162515911\" class=\"form-label\">Email <span class=\"star-required\">*<\/span><\/label><div class=\"invalid-feedback-frm\" role=\"alert\">Email is not valid.<\/div><\/div><div class=\"mf-field-wrapper form-floating col-sm-12\"><input type=\"text\" class=\"form-control\" id=\"_mf_127840_5799_213369305\" name=\"_mf_127840_5799\" placeholder=\"Company\" required \/><label for=\"_mf_127840_5799_213369305\" class=\"form-label\">Company <span class=\"star-required\">*<\/span><\/label><div class=\"invalid-feedback-frm\" role=\"alert\">Company is not valid.<\/div><\/div>\t\t<div class=\"mf_field mf_field--country mf_field--select floating form-country-select-parent mf-required\">\n\n\t\t\t<label for=\"_mf_127840_3422_198917988\" class=\"floating__label form-country-select-label\" data-content=\"Country\">\n\t\t\t\t<span class=\"floating-label-content\">Country<\/span>\n\t\t\t<\/label>\n\n\t\t\t<div class=\"select-wrap\">\n<i class=\"icon icon-zodiak-chevron-down\"><\/i>\n\t\t\t\t<select id=\"_mf_127840_3422_198917988\" class=\"mf_field__input empty mf-country-selectbox form_country_select\" name=\"_mf_127840_3422\" data-validate=\"select\" required>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"\"  selected='selected'>Country<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AF\" >Afghanistan<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AX\" >Aland Islands<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AL\" >Albania<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"DZ\" >Algeria<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AS\" >American Samoa<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AD\" >Andorra<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AO\" >Angola<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AI\" >Anguilla<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AQ\" >Antarctica<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AG\" >Antigua And Barbuda<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AR\" >Argentina<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AM\" >Armenia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AW\" >Aruba<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AU\" >Australia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AT\" >Austria<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AZ\" >Azerbaijan<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BS\" >Bahamas<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BH\" >Bahrain<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BD\" >Bangladesh<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BB\" >Barbados<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BY\" >Belarus<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BE\" >Belgium<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BZ\" >Belize<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BJ\" >Benin<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BM\" >Bermuda<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BT\" >Bhutan<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BO\" >Bolivia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BA\" >Bosnia And Herzegovina<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BW\" >Botswana<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BV\" >Bouvet Island<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BR\" >Brazil<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"IO\" >British Indian Ocean Territory<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BN\" >Brunei Darussalam<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BG\" >Bulgaria<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BF\" >Burkina Faso<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BI\" >Burundi<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"KH\" >Cambodia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CM\" >Cameroon<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CA\" >Canada<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CV\" >Cape Verde<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"KY\" >Cayman Islands<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CF\" >Central African Republic<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TD\" >Chad<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CL\" >Chile<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CN\" >China<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CX\" >Christmas Island<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CC\" >Cocos (Keeling) Islands<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CO\" >Colombia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"KM\" >Comoros<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CG\" >Congo<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CD\" >Congo, Democratic Republic<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CK\" >Cook Islands<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CR\" >Costa Rica<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CI\" >Cote D&#039;Ivoire<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"HR\" >Croatia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CU\" >Cuba<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CY\" >Cyprus<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CZ\" >Czech Republic<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"DK\" >Denmark<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"DJ\" >Djibouti<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"DM\" >Dominica<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"DO\" >Dominican Republic<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"EC\" >Ecuador<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"EG\" >Egypt<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SV\" >El Salvador<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GQ\" >Equatorial Guinea<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"ER\" >Eritrea<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"EE\" >Estonia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"ET\" >Ethiopia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"FK\" >Falkland Islands (Malvinas)<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"FO\" >Faroe Islands<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"FJ\" >Fiji<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"FI\" >Finland<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"FR\" >France<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GF\" >French Guiana<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"PF\" >French Polynesia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TF\" >French Southern Territories<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GA\" >Gabon<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GM\" >Gambia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GE\" >Georgia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"DE\" >Germany<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GH\" >Ghana<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GI\" >Gibraltar<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GR\" >Greece<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GL\" >Greenland<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GD\" >Grenada<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GP\" >Guadeloupe<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GU\" >Guam<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GT\" >Guatemala<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GG\" >Guernsey<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GN\" >Guinea<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GW\" >Guinea-Bissau<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GY\" >Guyana<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"HT\" >Haiti<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"HM\" >Heard Island &amp; Mcdonald Islands<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"VA\" >Holy See (Vatican City State)<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"HN\" >Honduras<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"HK\" >Hong Kong<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"HU\" >Hungary<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"IS\" >Iceland<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"IN\" >India<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"ID\" >Indonesia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"IR\" >Iran, Islamic Republic Of<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"IQ\" >Iraq<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"IE\" >Ireland<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"IM\" >Isle Of Man<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"IL\" >Israel<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"IT\" >Italy<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"JM\" >Jamaica<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"JP\" >Japan<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"JE\" >Jersey<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"JO\" >Jordan<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"KZ\" >Kazakhstan<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"KE\" >Kenya<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"KI\" >Kiribati<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"KR\" >Korea<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"KW\" >Kuwait<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"KG\" >Kyrgyzstan<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"LA\" >Lao People&#039;s Democratic Republic<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"LV\" >Latvia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"LB\" >Lebanon<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"LS\" >Lesotho<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"LR\" >Liberia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"LY\" >Libyan Arab Jamahiriya<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"LI\" >Liechtenstein<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"LT\" >Lithuania<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"LU\" >Luxembourg<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MO\" >Macao<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MK\" >Macedonia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MG\" >Madagascar<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MW\" >Malawi<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MY\" >Malaysia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MV\" >Maldives<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"ML\" >Mali<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MT\" >Malta<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MH\" >Marshall Islands<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MQ\" >Martinique<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MR\" >Mauritania<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MU\" >Mauritius<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"YT\" >Mayotte<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MX\" >Mexico<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"FM\" >Micronesia, Federated States Of<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MD\" >Moldova<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MC\" >Monaco<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MN\" >Mongolia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"ME\" >Montenegro<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MS\" >Montserrat<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MA\" >Morocco<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MZ\" >Mozambique<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MM\" >Myanmar<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"NA\" >Namibia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"NR\" >Nauru<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"NP\" >Nepal<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"NL\" >Netherlands<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AN\" >Netherlands Antilles<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"NC\" >New Caledonia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"NZ\" >New Zealand<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"NI\" >Nicaragua<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"NE\" >Niger<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"NG\" >Nigeria<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"NU\" >Niue<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"NF\" >Norfolk Island<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MP\" >Northern Mariana Islands<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"NO\" >Norway<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"OM\" >Oman<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"PK\" >Pakistan<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"PW\" >Palau<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"PS\" >Palestinian Territory, Occupied<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"PA\" >Panama<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"PG\" >Papua New Guinea<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"PY\" >Paraguay<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"PE\" >Peru<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"PH\" >Philippines<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"PN\" >Pitcairn<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"PL\" >Poland<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"PT\" >Portugal<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"PR\" >Puerto Rico<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"QA\" >Qatar<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"RE\" >Reunion<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"RO\" >Romania<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"RU\" >Russian Federation<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"RW\" >Rwanda<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"BL\" >Saint Barthelemy<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SH\" >Saint Helena<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"KN\" >Saint Kitts And Nevis<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"LC\" >Saint Lucia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"MF\" >Saint Martin<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"PM\" >Saint Pierre And Miquelon<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"VC\" >Saint Vincent And Grenadines<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"WS\" >Samoa<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SM\" >San Marino<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"ST\" >Sao Tome And Principe<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SA\" >Saudi Arabia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SN\" >Senegal<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"RS\" >Serbia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SC\" >Seychelles<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SL\" >Sierra Leone<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SG\" >Singapore<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SK\" >Slovakia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SI\" >Slovenia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SB\" >Solomon Islands<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SO\" >Somalia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"ZA\" >South Africa<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GS\" >South Georgia And Sandwich Isl.<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"ES\" >Spain<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"LK\" >Sri Lanka<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SD\" >Sudan<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SR\" >Suriname<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SJ\" >Svalbard And Jan Mayen<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SZ\" >Swaziland<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SE\" >Sweden<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"CH\" >Switzerland<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"SY\" >Syrian Arab Republic<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TW\" >Taiwan<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TJ\" >Tajikistan<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TZ\" >Tanzania<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TH\" >Thailand<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TL\" >Timor-Leste<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TG\" >Togo<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TK\" >Tokelau<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TO\" >Tonga<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TT\" >Trinidad And Tobago<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TN\" >Tunisia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TR\" >Turkey<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TM\" >Turkmenistan<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TC\" >Turks And Caicos Islands<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"TV\" >Tuvalu<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"UG\" >Uganda<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"UA\" >Ukraine<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"AE\" >United Arab Emirates<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"GB\" >United Kingdom<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"US\" >United States<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"UM\" >United States Outlying Islands<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"UY\" >Uruguay<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"UZ\" >Uzbekistan<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"VU\" >Vanuatu<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"VE\" >Venezuela<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"VN\" >Viet Nam<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"VG\" >Virgin Islands, British<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"VI\" >Virgin Islands, U.S.<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"WF\" >Wallis And Futuna<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"EH\" >Western Sahara<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"YE\" >Yemen<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"ZM\" >Zambia<\/option>\n\t\t\t\t\t\t\t\t\t\t\t<option value=\"ZW\" >Zimbabwe<\/option>\n\t\t\t\t\t\t\t\t\t<\/select>\n\n\t\t\t\t<div class=\"invalid-feedback-frm\" role=\"alert\">Country is not valid.<\/div>\n\t\t\t<\/div>\n\n\t\t<\/div>\n\n\t\t<script type=\"text\/javascript\">\n            jQuery(document).ready(function($) {\n                $('.mf_form__form').each(function() {\n                    var $form = $(this); \/\/ This specific form instance\n\n                    \/\/ Find the country select in this form\n                    $form.find('.form_country_select').each(function() {\n                        var $select = $(this);\n\t\t\t\t\t\tvar clickCount = 0;\n                        \/\/ On change\n                        $select.on('click', function() {\n\t\t\t\t\t\t\tclickCount++;\n\t\t\t\t\t\t\tif (clickCount === 1) {\n\t\t\t\t\t\t\t\t$(this).parent().find('.icon-zodiak-chevron-down').addClass('active');\n\t\t\t\t\t\t\t} else {\n\t\t\t\t\t\t\t\tclickCount = 0;\n\t\t\t\t\t\t\t\t$(this).parent().find('.icon-zodiak-chevron-down').removeClass('active');\n\t\t\t\t\t\t\t}\n\t\t\t\t\t\t});\n\t\t\t\t\t\t$select.on('blur', function() {\n\t\t\t\t\t\t\tclickCount = 0;\n\t\t\t\t\t\t\t$(this).parent().find('.icon-zodiak-chevron-down').removeClass('active');\n\t\t\t\t\t\t});\n                    });\n                });\n            });\n        <\/script>\n\n\t\t<div class=\"mf-field-wrapper form-floating col-sm-12\"><input type=\"text\" pattern=\"^[0-9\\-\\+\\s]+$\"  class=\"form-control\" id=\"_mf_127840_9781_1709984682\" name=\"_mf_127840_9781\" oninput=\"validateInput(this)\" maxlength=\"14\" placeholder=\"Phone\"  \/><label for=\"_mf_127840_9781_1709984682\" class=\"form-label\">Phone (optional)<\/label><\/div><div class=\"mf-field-wrapper form-floating col-sm-12\"><textarea type=\"text\" class=\"form-control\" id=\"_mf_127840_5321_992729244\" name=\"_mf_127840_5321\" placeholder=\"Your Message\" required><\/textarea><label for=\"_mf_127840_5321_992729244\" class=\"form-label\">Your Message <span class=\"star-required\">*<\/span><\/label><div class=\"invalid-feedback-frm\" role=\"alert\">Your Message is not valid.<\/div><\/div><div class=\"mf-field-wrapper  col-sm-12\">\n\t\t<div class=\"form-check checkbox-controls\">\n\n\t\t\t<input type=\"checkbox\" id=\"_mf_127840_1931_1700845191\" class=\"form-check-input\"\n\t\t\t\tname=\"_mf_127840_1931[]\"\n\t\t\t\tvalue=\"1\"\n\t\t\t\trequired\n\t\t\t>\n\n\t\t\t<label for=\"_mf_127840_1931_1700845191\" class=\"form-check-label consent-text\">\n\t\t\t\tI agree to Capgemini collecting and processing my personal data to allow me to receive information on Capgemini services. For further information, please see <a href=\"https:\/\/www.capgemini.com\/au-en\/privacy-notice\/\" target=\"_blank\">our Privacy Notice.  <\/a> &nbsp;\t\t\t<\/label>\n\n\t\t<\/div>\n\t\t<\/div>\t\t\t<div class=\"mf_field mf_field--recaptcha\">\n\t\t\t\t<div class=\"g-recaptcha\" data-sitekey=\"6Lc3OpIUAAAAADY4ErEHF0HF6Tr7vuknduDU-fbl\"><\/div>\n\t\t\t<\/div>\n\t\t\t\n\t\t\t<div class=\"mf_field mf_field--submit\" >\n\t\t\t\t<div class=\"slide-button-background button-background\">\n\t\t\t\t\t<label for=\"slider-submit-_mf_127840_3966\" class=\"slide-text\">\n\t\t\t\t\t\tSlide to submit\t\t\t\t\t<\/label>\n\t\t\t\t\t<input\n\t\t\t\t\t\tid=\"slider-submit-_mf_127840_3966\"\n\t\t\t\t\t\ttype=\"range\"\n\t\t\t\t\t\tclass=\"mf_field__input slider-frm-btn\"\n\t\t\t\t\t\trel=\"_mf_127840_3966\"\n\t\t\t\t\t\tmin=\"0\"\n\t\t\t\t\t\tmax=\"100\"\n\t\t\t\t\t\tvalue=\"0\"\n\t\t\t\t\t\taria-label=\"Slide to submit\"\n\t\t\t\t\t\taria-describedby=\"slide-instruction-_mf_127840_3966\"\n\t\t\t\t\t\taria-valuenow=\"0\"\n\t\t\t\t\t\taria-valuemin=\"0\"\n\t\t\t\t\t\taria-valuemax=\"100\"\n\t\t\t\t\t\taria-orientation=\"horizontal\"\n\t\t\t\t\t\trole=\"slider\"\n\t\t\t\t\t\ttabindex=\"0\"\n\t\t\t\t\t\/>\n\t\t\t\t\t<span id=\"slide-instruction-_mf_127840_3966\" class=\"sr-only\">\n\t\t\t\t\t\tUse right arrow keys to slide, or drag right with your finger. When you reach 100 percent, the form is submitted.\t\t\t\t\t<\/span>\n\t\t\t\t\t<!-- Mobile-only submit button fallback -->\n\t\t\t\t\t<button type=\"submit\" class=\"mf-mobile-submit-btn\" disabled>\n\t\t\t\t\t\t<span class=\"sr-only\">If you use a screen reader or VoiceOver, double-tap this button to submit the form.<\/span>\n\t\t\t\t\t\tSlide to submit\t\t\t\t\t<\/button>\n\t\t\t\t<\/div>\n\t\t\t\t<input type=\"hidden\" name=\"submit_btn_txt\" class=\"submit_btn_txt\" value=\"Slide to submit\"\/>\n\t\t\t\t<input type=\"hidden\" name=\"submitted_state_txt\" class=\"submitted_state_txt\" value=\"Submitted\"\/>\n\t\t\t<\/div>\n\t\t\t\t\t<div class=\"mf_field mf_field--hidden \">\n\t\t\t\t<label for=\"_mf_127840_2940_2533080922\">Expert title\t\t\t\t\t<\/label>\n\t\t\t\t<input type=\"hidden\" id=\"_mf_127840_2940_2533080922\" class=\"mf_field__input empty\" name=\"_mf_127840_2940\" data-validate=\"text\" data-hidden-field-tag=\"expert_title\" value=\"\"  \/>\n\t\t\t<\/div>\n\t\t\t\t\t\t<input type=\"hidden\" name=\"form_id\" data-validate=\"number\" class=\"mf_form__id\" value=\"127840\" \/>\n\t\t\t\t<input type=\"hidden\" name=\"form_title\" class=\"mf_form__title\" value=\"expert-connect-capgemini-australia-new-website-2022\" \/>\n\t\t\t\t<input type=\"hidden\" name=\"wp_rest_nonce\" class=\"mf_form__wp_rest_nonce\" value=\"c761b96a25\" \/>\n\n\t\t\t\t<input type=\"hidden\" name=\"mf_form_conditional_logic\" class=\"mf_form__title conditional_logic\" value=\"\" \/>\n\t\t\t\t\n\t\t\t\t<input type=\"hidden\" name=\"mf_form_fields_country_dpo_field\" class=\"mf_form__title conditional_logic mf_form_fields_country_dpo_field\" value=\"\" \/>\n\n\t\t\t\t<!-- Anti-spam field -->\n\t\t\t\t<input type=\"text\" \n\t\t\t\t\tname=\"website_url\" \n\t\t\t\t\tclass=\"mf_field__url\" \n\t\t\t\t\tautocomplete=\"off\"\n\t\t\t\t\ttabindex=\"-1\"\n\t\t\t\t\taria-hidden=\"true\"\n\t\t\t\t\tstyle=\"position:absolute;left:-9999px;width:1px;height:1px;opacity:0;pointer-events:none;\" \n\t\t\t\t\/>\n\t\t\t<\/form>\n\n\t\t\t<div class=\"mf_form__success\" tabindex=\"0\" role=\"alert\">\n\t\t\t\tThank you for filling out the form! You will be contacted shortly.<\/p>\n\t\t\t<\/div>\n\t\t\t<div class=\"mf_form__errors\">\n\t\t\t\t<p>We are sorry, the form submission failed. Please try again.<\/p>\n\t\t\t<\/div>\n\t\t\t\t<\/div>\n\n\t\t<script>\n\t\t\twindow.MF_CONFIG127840 = {\"127840\":{\"errors\":[],\"redirect\":\"\"}};\n\t\t<\/script>\n\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div><\/div><\/div><div class=\"slider-nav\"><button class=\"slider-prev inactive\" aria-label=\"Slider-previous\" tabindex=\"-1\"><\/button><ul class=\"slider-paginator\"><\/ul><button class=\"slider-next\" aria-label=\"Slider-next\"><\/button><\/div><\/div><\/section>\n\n\n<section class=\"section section--expert-perspectives\"><div class=\"container\"><div class=\"row\"><div class=\"content-title col-12 col-md-8\"><h2 class=\"expert-heading\">Expert perspectives<\/h2><\/div><\/div><div class=\"expert-prospective-container\"><div class=\"row\"><div class=\"col-12 col-md-4 row-space\"><div class=\"box\"><div class=\"box-img-wrapper\"><a href=\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/diversity-inclusion-and-generative-ai-in-financial-services\/\" aria-label=\"Diversity, inclusion, and generative AI in financial services\" tabindex=\"-1\"><img decoding=\"async\" class=\"box-img\" alt=\"\" src=\"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/Diversity_Inclusion_Gen_AI_in_FS-Page_Image.jpg?w=600&#038;quality=70\" style=\"object-position: 44% 52%; object-fit: cover;\" loading=\"lazy\" \/><\/a><\/div><div class=\"box-inner\"><div class=\"box-tag\">Data and AI, Gen AI, Technology<\/div><a class=\"content-box-title\" href=\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/diversity-inclusion-and-generative-ai-in-financial-services\/\" aria-label=\"Diversity, inclusion, and generative AI in financial services\"><h3 class=\"expert-subtitle\">Diversity, inclusion, and generative AI in financial services<\/h3><\/a><div class=\"box-bottom\">\n\t\t   <div class=\"box-logo\"><img decoding=\"async\" class=\"light\" loading=\"lazy\" alt=\"Capgemini\" src=\"https:\/\/www.capgemini.com\/au-en\/wp-content\/themes\/capgemini2025\/assets\/images\/cg-logo-blue.svg\" \/><img decoding=\"async\" class=\"dark\" loading=\"lazy\" alt=\"Capgemini\" src=\"https:\/\/www.capgemini.com\/au-en\/wp-content\/themes\/capgemini2025\/assets\/images\/cg-logo-white.svg\" \/><\/div><div class=\"date-name-info\"><div class=\"author-text\">Capgemini<\/div><div class=\"date-text\">Mar 4, 2025<\/div><\/div><\/div><\/div><\/div><\/div><div class=\"col-12 col-md-4 row-space\"><div class=\"box\"><div class=\"box-img-wrapper\"><a href=\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/building-a-data-driven-future-a-comprehensive-approach-to-data-democratization-and-organizational-growth\/\" aria-label=\"Building a data-driven future: A comprehensive approach to data democratization and organizational growth\" tabindex=\"-1\"><img decoding=\"async\" class=\"box-img\" alt=\"\" src=\"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/01\/Data_Democratization-Webpage_Background-1.jpg?w=600&#038;quality=70\" style=\"object-position: 50% 50%; object-fit: cover;\" loading=\"lazy\" \/><\/a><\/div><div class=\"box-inner\"><div class=\"box-tag\">Data and AI<\/div><a class=\"content-box-title\" href=\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/building-a-data-driven-future-a-comprehensive-approach-to-data-democratization-and-organizational-growth\/\" aria-label=\"Building a data-driven future: A comprehensive approach to data democratization and organizational growth\"><h3 class=\"expert-subtitle\">Building a data-driven future: A comprehensive approach to data democratization and organizational growth<\/h3><\/a><div class=\"box-bottom\">\n\t\t   <div class=\"box-logo\"><img decoding=\"async\" class=\"\" loading=\"lazy\" alt=\"\" src=\"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/01\/Sharat_Bangera.jpg?w=483\" \/><\/div><div class=\"date-name-info\"><div class=\"author-text\">Sharat Bangera<\/div><div class=\"date-text\">Nov 20, 2024<\/div><\/div><\/div><\/div><\/div><\/div><div class=\"col-12 col-md-4 row-space\"><div class=\"box\"><div class=\"box-img-wrapper\"><a href=\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/activating-gen-ai-at-scale-to-transform-financial-services-insights-and-best-practices-from-capgemini\/\" aria-label=\"Activating Gen AI at scale to transform financial services: Insights and best practices from Capgemini\" tabindex=\"-1\"><img decoding=\"async\" class=\"box-img\" alt=\"\" src=\"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2024\/11\/Gen_AI.jpg?w=600&#038;quality=70\" style=\"object-position: 50% 50%; object-fit: cover;\" loading=\"lazy\" \/><\/a><\/div><div class=\"box-inner\"><div class=\"box-tag\">Data and AI<\/div><a class=\"content-box-title\" href=\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/activating-gen-ai-at-scale-to-transform-financial-services-insights-and-best-practices-from-capgemini\/\" aria-label=\"Activating Gen AI at scale to transform financial services: Insights and best practices from Capgemini\"><h3 class=\"expert-subtitle\">Activating Gen AI at scale to transform financial services: Insights and best practices from Capgemini<\/h3><\/a><div class=\"box-bottom\">\n\t\t   <div class=\"box-logo\"><img decoding=\"async\" class=\"light\" loading=\"lazy\" alt=\"Capgemini\" src=\"https:\/\/www.capgemini.com\/au-en\/wp-content\/themes\/capgemini2025\/assets\/images\/cg-logo-blue.svg\" \/><img decoding=\"async\" class=\"dark\" loading=\"lazy\" alt=\"Capgemini\" src=\"https:\/\/www.capgemini.com\/au-en\/wp-content\/themes\/capgemini2025\/assets\/images\/cg-logo-white.svg\" \/><\/div><div class=\"date-name-info\"><div class=\"author-text\">Capgemini<\/div><div class=\"date-text\">Nov 1, 2024<\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/div><\/section>\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":12384,"featured_media":539121,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"cg_dt_proposed_to":[],"cg_seo_hreflang_relations":"[]","cg_seo_canonical_relation":"","cg_seo_hreflang_x_default_relation":"","cg_dt_approved_content":true,"cg_dt_mandatory_content":false,"cg_dt_notes":"","cg_dg_source_changed":false,"cg_dt_link_disabled":false,"_yoast_wpseo_primary_brand":"","_jetpack_memberships_contains_paid_content":false,"footnotes":"","featured_focal_points":""},"categories":[1],"tags":[],"brand":[66],"service":[172],"industry":[203,479,35],"partners":[],"blog-topic":[427,86],"content-group":[],"class_list":["post-539120","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-uncategorized","brand-capgemini","service-data-ai","industry-banking-capital-markets","industry-financial-services","industry-insurance","blog-topic-automation","blog-topic-data-and-ai"],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v22.8 (Yoast SEO v22.8) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Question-Answer Generation (QAG) for automated summarization evaluation: A reference-free approach - Capgemini Australia<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Question-Answer Generation (QAG) for automated summarization evaluation: A reference-free approach\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/\" \/>\n<meta property=\"og:site_name\" content=\"Capgemini Australia\" \/>\n<meta property=\"article:published_time\" content=\"2025-03-21T07:38:32+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2025-03-28T15:47:54+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/QAG-based_summarization_evaluation-Webpage_Image.jpeg\" \/>\n\t<meta property=\"og:image:width\" content=\"2880\" \/>\n\t<meta property=\"og:image:height\" content=\"1800\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Sangeeta Ron\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"jatinthanekar\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/\",\"url\":\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/\",\"name\":\"Question-Answer Generation (QAG) for automated summarization evaluation: A reference-free approach - Capgemini Australia\",\"isPartOf\":{\"@id\":\"https:\/\/www.capgemini.com\/au-en\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/QAG-based_summarization_evaluation-Webpage_Image.jpeg\",\"datePublished\":\"2025-03-21T07:38:32+00:00\",\"dateModified\":\"2025-03-28T15:47:54+00:00\",\"author\":{\"@id\":\"https:\/\/www.capgemini.com\/au-en\/#\/schema\/person\/e5ba693bc3ffeff9cefc94304842fca6\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/#primaryimage\",\"url\":\"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/QAG-based_summarization_evaluation-Webpage_Image.jpeg\",\"contentUrl\":\"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/QAG-based_summarization_evaluation-Webpage_Image.jpeg\",\"width\":2880,\"height\":1800,\"caption\":\"Big data technology Data science analysing artificial intelligence generative AI deep learning machine learning algorithm Neural flow network analytics innovation abstract futuristic. 3d rendering.\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.capgemini.com\/au-en\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Question-Answer Generation (QAG) for automated summarization evaluation: A reference-free approach\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.capgemini.com\/au-en\/#website\",\"url\":\"https:\/\/www.capgemini.com\/au-en\/\",\"name\":\"Capgemini Australia\",\"description\":\"Capgemini\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.capgemini.com\/au-en\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.capgemini.com\/au-en\/#\/schema\/person\/e5ba693bc3ffeff9cefc94304842fca6\",\"name\":\"jatinthanekar\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.capgemini.com\/au-en\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/efd5bb674c39bf78397d271a0d5a3adb7cd5ca71fe692c7dbca3c4811a1d5680?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/efd5bb674c39bf78397d271a0d5a3adb7cd5ca71fe692c7dbca3c4811a1d5680?s=96&d=mm&r=g\",\"caption\":\"jatinthanekar\"},\"url\":\"https:\/\/www.capgemini.com\/au-en\/author\/jatinthanekar\/\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"Question-Answer Generation (QAG) for automated summarization evaluation: A reference-free approach - Capgemini Australia","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/","og_locale":"en_US","og_type":"article","og_title":"Question-Answer Generation (QAG) for automated summarization evaluation: A reference-free approach","og_url":"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/","og_site_name":"Capgemini Australia","article_published_time":"2025-03-21T07:38:32+00:00","article_modified_time":"2025-03-28T15:47:54+00:00","og_image":[{"width":2880,"height":1800,"url":"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/QAG-based_summarization_evaluation-Webpage_Image.jpeg","type":"image\/jpeg"}],"author":"Sangeeta Ron","twitter_card":"summary_large_image","twitter_misc":{"Written by":"jatinthanekar","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/","url":"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/","name":"Question-Answer Generation (QAG) for automated summarization evaluation: A reference-free approach - Capgemini Australia","isPartOf":{"@id":"https:\/\/www.capgemini.com\/au-en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/#primaryimage"},"image":{"@id":"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/#primaryimage"},"thumbnailUrl":"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/QAG-based_summarization_evaluation-Webpage_Image.jpeg","datePublished":"2025-03-21T07:38:32+00:00","dateModified":"2025-03-28T15:47:54+00:00","author":{"@id":"https:\/\/www.capgemini.com\/au-en\/#\/schema\/person\/e5ba693bc3ffeff9cefc94304842fca6"},"breadcrumb":{"@id":"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/#primaryimage","url":"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/QAG-based_summarization_evaluation-Webpage_Image.jpeg","contentUrl":"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/QAG-based_summarization_evaluation-Webpage_Image.jpeg","width":2880,"height":1800,"caption":"Big data technology Data science analysing artificial intelligence generative AI deep learning machine learning algorithm Neural flow network analytics innovation abstract futuristic. 3d rendering."},{"@type":"BreadcrumbList","@id":"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.capgemini.com\/au-en\/"},{"@type":"ListItem","position":2,"name":"Question-Answer Generation (QAG) for automated summarization evaluation: A reference-free approach"}]},{"@type":"WebSite","@id":"https:\/\/www.capgemini.com\/au-en\/#website","url":"https:\/\/www.capgemini.com\/au-en\/","name":"Capgemini Australia","description":"Capgemini","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.capgemini.com\/au-en\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/www.capgemini.com\/au-en\/#\/schema\/person\/e5ba693bc3ffeff9cefc94304842fca6","name":"jatinthanekar","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.capgemini.com\/au-en\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/efd5bb674c39bf78397d271a0d5a3adb7cd5ca71fe692c7dbca3c4811a1d5680?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/efd5bb674c39bf78397d271a0d5a3adb7cd5ca71fe692c7dbca3c4811a1d5680?s=96&d=mm&r=g","caption":"jatinthanekar"},"url":"https:\/\/www.capgemini.com\/au-en\/author\/jatinthanekar\/"}]}},"blog_topic_info":[{"id":427,"name":"Automation"},{"id":86,"name":"Data and AI"}],"taxonomy_info":{"category":[{"id":1,"name":"Uncategorized","slug":"uncategorized"}],"brand":[{"id":66,"name":"Capgemini","slug":"capgemini"}],"service":[{"id":172,"name":"Data &amp; AI","slug":"data-ai"}],"industry":[{"id":203,"name":"Banking &amp; capital markets","slug":"banking-capital-markets"},{"id":479,"name":"Financial services","slug":"financial-services"},{"id":35,"name":"Insurance","slug":"insurance"}],"blog-topic":[{"id":427,"name":"Automation","slug":"automation"},{"id":86,"name":"Data and AI","slug":"data-and-ai"}],"following_users":[{"id":505,"name":"jatinthanekar","slug":"jatinthanekar"},{"id":376,"name":"shilpasingh","slug":"shilpasingh"}]},"parsely":{"version":"1.1.0","canonical_url":"https:\/\/capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/","smart_links":{"inbound":0,"outbound":0},"traffic_boost_suggestions_count":0,"meta":{"@context":"https:\/\/schema.org","@type":"NewsArticle","headline":"Question-Answer Generation (QAG) for automated summarization evaluation: A reference-free approach","url":"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/","mainEntityOfPage":{"@type":"WebPage","@id":"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/"},"thumbnailUrl":"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/QAG-based_summarization_evaluation-Webpage_Image.jpeg?w=150&h=150&crop=1","image":{"@type":"ImageObject","url":"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/QAG-based_summarization_evaluation-Webpage_Image.jpeg"},"articleSection":"Uncategorized","author":[],"creator":[],"publisher":{"@type":"Organization","name":"Capgemini Australia","logo":""},"keywords":[],"dateCreated":"2025-03-21T07:38:32Z","datePublished":"2025-03-21T07:38:32Z","dateModified":"2025-03-28T15:47:54Z"},"rendered":"<meta name=\"parsely-title\" content=\"Question-Answer Generation (QAG) for automated summarization evaluation: A reference-free approach\" \/>\n<meta name=\"parsely-link\" content=\"https:\/\/www.capgemini.com\/au-en\/insights\/expert-perspectives\/question-answer-generation-qag-for-automated-summarization-evaluation-a-reference-free-approach\/\" \/>\n<meta name=\"parsely-type\" content=\"post\" \/>\n<meta name=\"parsely-image-url\" content=\"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/QAG-based_summarization_evaluation-Webpage_Image.jpeg?w=150&amp;h=150&amp;crop=1\" \/>\n<meta name=\"parsely-pub-date\" content=\"2025-03-21T07:38:32Z\" \/>\n<meta name=\"parsely-section\" content=\"Uncategorized\" \/>","tracker_url":"https:\/\/cdn.parsely.com\/keys\/capgemini.com\/p.js"},"jetpack_featured_media_url":"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/QAG-based_summarization_evaluation-Webpage_Image.jpeg","archive_status":false,"featured_image_src":"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/QAG-based_summarization_evaluation-Webpage_Image.jpeg","featured_image_alt":"","jetpack_sharing_enabled":true,"distributor_meta":false,"distributor_terms":false,"distributor_media":false,"distributor_original_site_name":"Capgemini Australia","distributor_original_site_url":"https:\/\/www.capgemini.com\/au-en","push-errors":false,"featured_image_url":"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/QAG-based_summarization_evaluation-Webpage_Image.jpeg","author_title":"Sangeeta Ron","author_thumbnail_url":"https:\/\/www.capgemini.com\/au-en\/wp-content\/uploads\/sites\/10\/2025\/03\/SRon-Headshot1.png?w=305","author_thumbnail_alt":"","_links":{"self":[{"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/posts\/539120","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/users\/12384"}],"replies":[{"embeddable":true,"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/comments?post=539120"}],"version-history":[{"count":4,"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/posts\/539120\/revisions"}],"predecessor-version":[{"id":539147,"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/posts\/539120\/revisions\/539147"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/media\/539121"}],"wp:attachment":[{"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/media?parent=539120"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/categories?post=539120"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/tags?post=539120"},{"taxonomy":"brand","embeddable":true,"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/brand?post=539120"},{"taxonomy":"service","embeddable":true,"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/service?post=539120"},{"taxonomy":"industry","embeddable":true,"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/industry?post=539120"},{"taxonomy":"partners","embeddable":true,"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/partners?post=539120"},{"taxonomy":"blog-topic","embeddable":true,"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/blog-topic?post=539120"},{"taxonomy":"content-group","embeddable":true,"href":"https:\/\/www.capgemini.com\/au-en\/wp-json\/wp\/v2\/content-group?post=539120"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}