Discussions

• 1 You must be logged in to vote

  📣

  John Snow Labs releases LangTest 2.3.0: Enhancing LLM Evaluation with Multi-Model, Multi-Dataset Support, Drug Name Swapping Tests, Prometheus Integration, Safety Testing, and Improved Logging

  chakravarthik27 announced Jul 16, 2024 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs releases LangTest 2.2.0: Advancing Language Model Testing with Model Comparison and Benchmarking, Few-Shot Evaluation, NER Evaluation for LLMs, Enhanced Data Augmentation, and Customized Multi-Dataset Prompts

  chakravarthik27 announced May 15, 2024 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 2.0.0: Comprehensive Model Benchmarking, Added support for LM Studio , CLI Integration for Embedding Benchmarks, Enhanced Toxicity Tests, Multi-Dataset Comparison and elevated user experience with various bug fixes and enhancements.

  ArshaanNazir announced Feb 21, 2024 in Announcements

  

  

  0
• 2 You must be logged in to vote

  🙏

  Issues setting up

  lpalomares asked Jan 30, 2024 in Q&A · Answered

  

  

  6
• 2 You must be logged in to vote

  💬

  I am curious if the evaluation results of Langtest only have a pass rate?

  VelikayaScarlet started Jan 26, 2024 in General

  

  

  1
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.10.0: Support for Evaluating RAG with LlamaIndex and Langtest, Grammar Testing, Robust Checkpoint Managememt, and Comprehensive Support for Medical Datasets (LiveQA, MedicationQA, HealthSearchQA), Direct Hugging Face Model Integration and Elevated User Experience with Numerous Bug Fixes !

  ArshaanNazir announced Dec 23, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.9.0: Hugging Face Callback Integration, Advanced Templatic Augmentation, Comprehensive Model Benchmarking, Expanded Clinical Dataset Support (MedQA, PubMedQA, MedMCQ), Insightful Blogposts, and Enhanced User Experience with Key Bug Fixes

  ArshaanNazir announced Dec 1, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.8.0: Codebase Refactoring, Enhanced Debugging with Error Codes, Streamlined Categorization of Tasks, Various Blogposts, Improved Open Source Community Standards and Enhanced User Experience through Multiple Bug Fixes !

  ArshaanNazir announced Nov 10, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.7.0: Broadening Question-Answering Evaluation, Custom Model APIs, StereoSet Integration, FiQA Dataset, New BlogPosts, Gender Occupational Bias Assessment in LLMs and Enhanced User Experience through Multiple Bug Fixes !

  ArshaanNazir announced Oct 24, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  🙏

  Custom model API endpoint support

  WiktorSobanski asked Sep 13, 2023 in Q&A · Answered

  

  

  3
• 3 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.6.0: Broadening Benchmark Horizons with CommonSenseQA, PIQA, SIQA Datasets, Unveiling Toxicity Sensitivity Test, Legal-QA Evaluations Enriched with Consumer Contracts, Privacy-Policy, Contracts-QA Datasets, Challenging Biases with Sycophancy and Crows-Pairs Stereotype Tests, and Enhanced User Experience through Multiple Bug Fixes.

  ArshaanNazir announced Oct 3, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.5.0: Gender Stereotype Analysis with Wino-Bias, Enhancement with Legal-Support, Legal-Summarization (Multi-LexSum Dataset), Factuality & Negation-Sensitivity Tests, Updated Gender Classifier, and Streamlined Bug Resolutions for Better User Experience.

  ArshaanNazir announced Sep 19, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.4.0 : Unveiling Political Compass & Disinformation Tests for LLMs, Inclusion of Novel Datasets (LogiQA, asdiv, Bigbench), Enhanced QA & Summarization for HF Models, Refined Codebase, Amplified Test Evaluations, and Comprehensive Bug Fixes for Optimal User Experience.

  ArshaanNazir announced Sep 4, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.3.0: Clinical Test Support, Model & Dataset Uploading to HF, Prompt-Injection Exploration, Codebase Refinement, Enhanced Unit Test Coverage and Support for custom column names for CSV loading.

  ArshaanNazir announced Aug 18, 2023 in Announcements

  

  

  0
• 1 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.2.0: Enhancing Support for HF Dataset Augmentations, Advanced HF NER Support, Seamless End-to-End NER-HF Pipelines, Support for MLflow Metric Tracking and Performance Benchmarking with Speed Tests.

  ArshaanNazir announced Aug 3, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs LangTest 1.1.0: Enhancing Support for different toxicity tests, templatic augmentations, BBQ-data, HF dataset support for summarization, CSV augmentations in text classification and new robustness tests.

  ArshaanNazir announced Jul 18, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs - LangTest 1.0.0: An open-source library for delivering safe & effective models into production!

  ArshaanNazir announced Jul 3, 2023 in Announcements

  

  

  0
• 4 You must be logged in to vote

  📣

  John Snow Labs NLP Test 1.5.0: Amplifying Model Comparisons, Bias Tests, Runtime Checks, Harnessing HF Datasets for Superior Text Classification and Introducing Augmentation Proportion Control

  ArshaanNazir announced Jun 16, 2023 in Announcements

  

  

  0
• 3 You must be logged in to vote

  📣

  John Snow Labs NLP Test 1.4.0: Enhancing Support for Toxicity test and new QA benchmark datasets (NarrativeQA, TruthfulQA, QuAC, HellaSwag, MMLU and OpenbookQA)

  ArshaanNazir announced Jun 6, 2023 in Announcements

  

  

  0
• 3 You must be logged in to vote

  💡

  Sentence Embeddings bias

  rafaljanwojcik started May 26, 2023 in Ideas

  

  

  1
• 3 You must be logged in to vote

  📣

  John Snow Labs NLP Test 1.3.0: Enhancing Support for Evaluating Large Language Models in Summarization

  ArshaanNazir announced May 25, 2023 in Announcements

  

  

  0
• 4 You must be logged in to vote

  📣

  John Snow Labs NLP Test 1.2.0: Announcing Support for Cohere, AI21, Azure OpenAI and Hugging Face Inference API

  ArshaanNazir announced May 13, 2023 in Announcements

  

  

  0
• 4 You must be logged in to vote

  📣

  John Snow Labs NLP Test 1.1.0: Announcing Support for Testing LLMs

  luca-martial announced May 2, 2023 in Announcements

  

  

  0
• 2 You must be logged in to vote

  📣

  John Snow Labs NLP Test 1.0.2: Patch Release

  luca-martial announced Apr 21, 2023 in Announcements

  

  

  0
• 3 You must be logged in to vote

  📣

  John Snow Labs NLP Test 1.0.1: Patch Release

  luca-martial announced Apr 7, 2023 in Announcements

  

  

  0