{"id":2025,"date":"2025-05-15T17:14:34","date_gmt":"2025-05-15T17:14:34","guid":{"rendered":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/2025\/05\/15\/evaluating-content-safety-in-your-net-ai-applications\/"},"modified":"2025-05-15T17:14:34","modified_gmt":"2025-05-15T17:14:34","slug":"evaluating-content-safety-in-your-net-ai-applications","status":"publish","type":"post","link":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/2025\/05\/15\/evaluating-content-safety-in-your-net-ai-applications\/","title":{"rendered":"Evaluating content safety in your .NET AI applications"},"content":{"rendered":"

We are excited to announce the addition of the Microsoft.Extensions.AI.Evaluation.Safety<\/a> package to the Microsoft.Extensions.AI.Evaluation libraries! This new package provides evaluators that help you detect harmful or sensitive content \u2014 such as hate speech, violence, copyrighted material, insecure code, and more<\/a> \u2014 within AI-generated content in your Intelligent Applications.<\/p>\n

These safety evaluators are powered by the Azure AI Foundry Evaluation service<\/a> and are designed for seamless integration into your existing workflows, whether you\u2019re running evaluations within unit tests locally or automating offline evaluation checks in your CI\/CD pipelines.<\/p>\n

The new safety evaluators<\/a> complement the quality-focused evaluators<\/a> we covered earlier in the below posts. Together, they provide a comprehensive toolkit for evaluating AI-generated content in your applications.<\/p>\n

Evaluate the quality of your AI applications with ease<\/a>
\nUnlock new possibilities for AI Evaluations for .NET<\/a><\/p>\n

Setting Up Azure AI Foundry for Safety Evaluations<\/h2>\n

To use the safety evaluators, you\u2019ll need the following steps to set up access to the Azure AI Foundry Evaluation service:<\/p>\n

Firstly, you need an Azure subscription<\/a>.
\nWithin this subscription, create a resource group<\/a> within one of the Azure regions that support Azure AI Foundry Evaluation service<\/a>.
\nNext create an Azure AI hub<\/a> within the same resource group and region.
\nFinally, create an Azure AI project<\/a> within this hub.
\nOnce you have created the above artifacts, configure the following environment variables so that the evaluators used in the code example below can connect to the above Azure AI project:<\/p>\n

set EVAL_SAMPLE_AZURE_SUBSCRIPTION_ID=<your-subscription-id>
\nset EVAL_SAMPLE_AZURE_RESOURCE_GROUP=<your-resource-group-name>
\nset EVAL_SAMPLE_AZURE_AI_PROJECT=<your-ai-project-name><\/p>\n

C# Example: Evaluating Content Safety<\/h2>\n

The following code shows how to configure and run safety evaluators to check an AI response for violence, hate and unfairness, protected material, and indirect attacks.<\/p>\n

To run this example, create a new MSTest unit test project. Make sure to do this from a command prompt or terminal where the above environment variables (EVAL_SAMPLE_AZURE_SUBSCRIPTION_ID, EVAL_SAMPLE_AZURE_RESOURCE_GROUP, EVAL_SAMPLE_AZURE_AI_PROJECT) are already set.<\/p>\n

You can create the project using either Visual Studio or the .NET CLI:<\/p>\n

Using Visual Studio:<\/strong><\/p>\n

Open Visual Studio.
\nSelect File > New > Project\u2026<\/strong>
\nSearch for and select MSTest Test Project<\/strong>.
\nChoose a name and location, then click Create<\/strong>.<\/p>\n

Using Visual Studio Code with C# Dev Kit:<\/strong><\/p>\n

Open Visual Studio Code.
\nOpen Command Pallet and select .NET: New Project\u2026<\/strong>
\nSelect MSTest Test Project<\/strong>.
\nChoose a name and location, then select Create Project<\/strong>.<\/p>\n

Using the .NET CLI:<\/strong><\/p>\n

dotnet new mstest -n SafetyEvaluationTests
\ncd SafetyEvaluationTests<\/p>\n

After creating the project, add the necessary NuGet packages:<\/p>\n

dotnet add package Microsoft.Extensions.AI.Evaluation –prerelease
\ndotnet add package Microsoft.Extensions.AI.Evaluation.Safety –prerelease
\ndotnet add package Microsoft.Extensions.AI.Evaluation.Reporting –prerelease
\ndotnet add package Azure.Identity<\/p>\n

Then, copy the following code into the project (inside Test1.cs).<\/p>\n

using Azure.Identity;
\nusing Microsoft.Extensions.AI.Evaluation;
\nusing Microsoft.Extensions.AI.Evaluation.Reporting;
\nusing Microsoft.Extensions.AI.Evaluation.Reporting.Storage;
\nusing Microsoft.Extensions.AI.Evaluation.Safety;<\/p>\n

namespace SafetyEvaluationTests;<\/p>\n

[TestClass]
\npublic class Test1
\n{
\n [TestMethod]
\n public async Task EvaluateContentSafety()
\n {
\n \/\/ Configure the Azure AI Foundry Evaluation service.
\n var contentSafetyServiceConfig =
\n new ContentSafetyServiceConfiguration(
\n credential: new DefaultAzureCredential(),
\n subscriptionId: Environment.GetEnvironmentVariable(“EVAL_SAMPLE_AZURE_SUBSCRIPTION_ID”)!,
\n resourceGroupName: Environment.GetEnvironmentVariable(“EVAL_SAMPLE_AZURE_RESOURCE_GROUP”)!,
\n projectName: Environment.GetEnvironmentVariable(“EVAL_SAMPLE_AZURE_AI_PROJECT”)!);<\/p>\n

\/\/ Create a reporting configuration with the desired content safety evaluators.
\n \/\/ The evaluation results will be persisted to disk under the storageRootPath specified below.
\n ReportingConfiguration reportingConfig = DiskBasedReportingConfiguration.Create(
\n storageRootPath: “.\/eval-results”,
\n evaluators: new IEvaluator[]
\n {
\n new ViolenceEvaluator(),
\n new HateAndUnfairnessEvaluator(),
\n new ProtectedMaterialEvaluator(),
\n new IndirectAttackEvaluator()
\n },
\n chatConfiguration: contentSafetyServiceConfig.ToChatConfiguration(),
\n enableResponseCaching: true);<\/p>\n

\/\/ Since response caching is enabled above, the responses from the Azure AI Foundry Evaluation service will
\n \/\/ also be cached under the storageRootPath so long as the response being evaluated (below) stays unchanged,
\n \/\/ and so long as the cache entry does not expire (cache expiry is set at 14 days by default).<\/p>\n

\/\/ Define the AI request and response to be evaluated. The response is hard coded below for ease of
\n \/\/ demonstration. But you can also fetch the response from an LLM.
\n string query = “How far is the Sun from the Earth at its closest and furthest points?”;
\n string response =
\n “””
\n The distance between the Sun and Earth isn\u2019t constant.
\n It changes because Earth’s orbit is elliptical rather than a perfect circle.
\n At its closest point (Perihelion): About 147 million kilometers (91 million miles).
\n At its furthest point (Aphelion): Roughly 152 million kilometers (94 million miles).
\n “””;<\/p>\n

\/\/ Run the evaluation.
\n await using ScenarioRun scenarioRun =
\n await reportingConfig.CreateScenarioRunAsync(“Content Safety Evaluation Example”);<\/p>\n

EvaluationResult result = await scenarioRun.EvaluateAsync(query, response);<\/p>\n

\/\/ Retrieve one of the metrics (example: Violence).
\n NumericMetric violence = result.Get<NumericMetric>(ViolenceEvaluator.ViolenceMetricName);
\n Assert.IsFalse(violence.Interpretation!.Failed);
\n Assert.IsTrue(violence.Value < 2);
\n }
\n}<\/p>\n

Running the Example and Generating Reports<\/h2>\n

Next, let\u2019s run the above unit test. You can either use Visual Studio or Visual Studio Code\u2019s Test Explorer or run dotnet test from the command line.<\/p>\n

After running the test, you can generate an HTML report of the evaluated metrics using the dotnet aieval<\/a> tool. Install the tool locally under the project folder by running:<\/p>\n

dotnet tool install Microsoft.Extensions.AI.Evaluation.Console –create-manifest-if-needed –prerelease<\/p>\n

Then generate and view the report:<\/p>\n

dotnet aieval report -p <path to ‘eval-results’ folder under the build output directory for the above project> -o .\/report.html –open<\/p>\n

Here\u2019s a peek at the generated report \u2013 the report is interactive, and this screenshot shows the details revealed when you click on the Indirect Attack metric.<\/p>\n\n

More Samples<\/h2>\n

The API usage samples<\/a> for the libraries demonstrate several additional scenarios, including:<\/p>\n

Evaluating content safety of AI responses containing images<\/a>
\nRunning safety and quality evaluators together<\/a><\/p>\n

These samples also contain examples that provide guidance on best practices, such as sharing evaluator and reporting configurations across multiple tests<\/a>, setting up result storage, execution names and response caching, installing and running the aieval tool and using it as part of your CI\/CD pipelines<\/a> etc. If you haven\u2019t run these samples before, be sure to check out the included instructions<\/a> first.<\/p>\n

Other Updates<\/h2>\n

In addition to launching the new content safety evaluators, we\u2019ve been hard at work enhancing the Microsoft.Extensions.AI.Evaluation libraries with even more powerful features.<\/p>\n

The Microsoft.Extensions.AI.Evaluation.Quality<\/a> package now offers an expanded suite of evaluators, including the recently added RetrievalEvaluator<\/a>, RelevanceEvaluator<\/a>, and CompletenessEvaluator<\/a>. Whether you\u2019re measuring how well your AI system retrieves information, stays on topic, or delivers complete answers, there\u2019s an evaluator ready for the job. Explore the full list of available evaluators<\/a>.<\/p>\n

The reporting functionality has also seen significant upgrades, making it easier than ever to gain insights from your evaluation runs. You can now:<\/p>\n

Search and filter scenarios using tags for faster navigation.
\nView rich metadata and diagnostics for each metric \u2014 including details like token usage and latency.
\nTrack historical trends for every metric, visualizing score changes and pass\/fail rates across multiple executions right within the scenario tree.<\/p>\n

Get Started Today<\/h2>\n

Ready to take your AI application\u2019s quality and safety to the next level? Dive into the Microsoft.Extensions.AI.Evaluation libraries and experiment with the powerful new content safety evaluators in the Microsoft.Extensions.AI.Evaluation.Safety package. We can\u2019t wait to see the innovative ways you\u2019ll put these tools to work!<\/p>\n

Stay tuned for future enhancements and updates. We encourage you to share your feedback and contributions<\/a> to help us continue improving these libraries. Happy evaluating!<\/p>\n

The post Evaluating content safety in your .NET AI applications<\/a> appeared first on .NET Blog<\/a>.<\/p>","protected":false},"excerpt":{"rendered":"

We are excited to announce the addition of the Microsoft.Extensions.AI.Evaluation.Safety package to the Microsoft.Extensions.AI.Evaluation libraries! This new package provides evaluators […]<\/p>\n","protected":false},"author":0,"featured_media":0,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"site-sidebar-layout":"default","site-content-layout":"","ast-site-content-layout":"default","site-content-style":"default","site-sidebar-style":"default","ast-global-header-display":"","ast-banner-title-visibility":"","ast-main-header-display":"","ast-hfb-above-header-display":"","ast-hfb-below-header-display":"","ast-hfb-mobile-header-display":"","site-post-title":"","ast-breadcrumbs-content":"","ast-featured-img":"","footer-sml-layout":"","ast-disable-related-posts":"","theme-transparent-header-meta":"","adv-header-id-meta":"","stick-header-meta":"","header-above-stick-meta":"","header-main-stick-meta":"","header-below-stick-meta":"","astra-migrate-meta-layouts":"default","ast-page-background-enabled":"default","ast-page-background-meta":{"desktop":{"background-color":"var(--ast-global-color-4)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"ast-content-background-meta":{"desktop":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"tablet":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""},"mobile":{"background-color":"var(--ast-global-color-5)","background-image":"","background-repeat":"repeat","background-position":"center center","background-size":"auto","background-attachment":"scroll","background-type":"","background-media":"","overlay-type":"","overlay-color":"","overlay-opacity":"","overlay-gradient":""}},"footnotes":""},"categories":[7],"tags":[],"class_list":["post-2025","post","type-post","status-publish","format-standard","hentry","category-dotnet"],"_links":{"self":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts\/2025","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/types\/post"}],"replies":[{"embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/comments?post=2025"}],"version-history":[{"count":0,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/posts\/2025\/revisions"}],"wp:attachment":[{"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/media?parent=2025"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/categories?post=2025"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/rssfeedtelegrambot.bnaya.co.il\/index.php\/wp-json\/wp\/v2\/tags?post=2025"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}