Announcing the Launch of our LLM Routing Engine

Pioneering AI Solutions for the Legal Profession: Secure, Flexible, and Future-Proof

3
 min. read
May 30, 2024
Announcing the Launch of our LLM Routing Engine

At CaseMark, we are thrilled to announce the internal launch of our LLM Routing Engine.

Our customers expect the highest standards of security and privacy in our platform, which we consider fundamental. Beyond that, they seek a partner who can guide them through the transformative decade ahead, as AI tools become integral to the legal profession. To meet this need, we've developed a solution that remains both cloud-provider and LLM agnostic, ensuring we deliver the most compelling, cost-effective, efficient, and accurate solutions. The LLM Routing Engine embodies these efforts.

Early on, we realized that simply integrating OpenAI APIs would not suffice to build a compelling business. Our customers have grown wary of OpenAI’s ability to meet the stringent security and privacy demands of the legal profession. While we do utilize OpenAI LLMs, we do so within Microsoft Azure’s secure cloud infrastructure. Additionally, we now leverage a broad range of models across AWS and Google Cloud for various workflows. This flexibility allows us to utilize the best solutions available, delivering a cost-effective and highly accurate solution for our customers.

The CaseMark LLM Routing engine gives us the flexibility to be cloud and LLM agnostic.

Another critical reason for developing our LLM Routing Engine was to address issues around sensitive topics that often trigger content filtering. Major LLM providers like Meta, Alphabet, Anthropic, and OpenAI have robust content filtering to prevent misuse, such as generating harmful information. However, this filtering can hinder our customers' ability to address sensitive issues like loss of consortium, sexual assault, or hate crimes—topics prevalent in family law, criminal, and civil rights cases. Our LLM Routing Engine enables us to route around these content filters, ensuring our premium customers can continue their important work without interruption.

We are confident that our LLM Routing Engine will empower our customers to navigate the evolving legal landscape with cutting-edge AI solutions that uphold the highest standards of security, privacy, and effectiveness.

--

About CaseMark

At CaseMark, we're pioneering the integration of artificial intelligence in the legal sector. Our suite of tools, including Workflow and Productivity are designed to enhance the efficiency and effectiveness of legal professionals. Leveraging the power of advanced AI models in a secure and user-friendly platform, we provide solutions that are not just innovative but also respect the integrity and ethics of the legal profession.

Connect with Us

  • Explore our range of AI-powered legal tools.
  • Stay updated with our latest insights on the CaseMark Blog.
  • Learn More about our mission and vision.
  • Have questions? Contact us today for more information or to schedule a demo.

Follow Us

CaseMark – Empowering Legal Precision: One Workflow at a Time.

Announcing the Launch of our LLM Routing Engine

Pioneering AI Solutions for the Legal Profession: Secure, Flexible, and Future-Proof

3
 min. read
May 30, 2024
Announcing the Launch of our LLM Routing Engine

At CaseMark, we are thrilled to announce the internal launch of our LLM Routing Engine.

Our customers expect the highest standards of security and privacy in our platform, which we consider fundamental. Beyond that, they seek a partner who can guide them through the transformative decade ahead, as AI tools become integral to the legal profession. To meet this need, we've developed a solution that remains both cloud-provider and LLM agnostic, ensuring we deliver the most compelling, cost-effective, efficient, and accurate solutions. The LLM Routing Engine embodies these efforts.

Early on, we realized that simply integrating OpenAI APIs would not suffice to build a compelling business. Our customers have grown wary of OpenAI’s ability to meet the stringent security and privacy demands of the legal profession. While we do utilize OpenAI LLMs, we do so within Microsoft Azure’s secure cloud infrastructure. Additionally, we now leverage a broad range of models across AWS and Google Cloud for various workflows. This flexibility allows us to utilize the best solutions available, delivering a cost-effective and highly accurate solution for our customers.

The CaseMark LLM Routing engine gives us the flexibility to be cloud and LLM agnostic.

Another critical reason for developing our LLM Routing Engine was to address issues around sensitive topics that often trigger content filtering. Major LLM providers like Meta, Alphabet, Anthropic, and OpenAI have robust content filtering to prevent misuse, such as generating harmful information. However, this filtering can hinder our customers' ability to address sensitive issues like loss of consortium, sexual assault, or hate crimes—topics prevalent in family law, criminal, and civil rights cases. Our LLM Routing Engine enables us to route around these content filters, ensuring our premium customers can continue their important work without interruption.

We are confident that our LLM Routing Engine will empower our customers to navigate the evolving legal landscape with cutting-edge AI solutions that uphold the highest standards of security, privacy, and effectiveness.

--

About CaseMark

At CaseMark, we're pioneering the integration of artificial intelligence in the legal sector. Our suite of tools, including Workflow and Productivity are designed to enhance the efficiency and effectiveness of legal professionals. Leveraging the power of advanced AI models in a secure and user-friendly platform, we provide solutions that are not just innovative but also respect the integrity and ethics of the legal profession.

Connect with Us

  • Explore our range of AI-powered legal tools.
  • Stay updated with our latest insights on the CaseMark Blog.
  • Learn More about our mission and vision.
  • Have questions? Contact us today for more information or to schedule a demo.

Follow Us

CaseMark – Empowering Legal Precision: One Workflow at a Time.

Summary Type
Best for Case Types
Primary Purpose
Complexity Handling
Production Time
Best for Team Members
Key Information Highlighted
Narrative
General; personal injury
Initial review; client communication
Low to Medium
Medium
All; Clients
Overall story
Page Line
Complex litigation
Detailed analysis; trial prep
High
Low
Attorneys
Specific testimony details
Topical
Multi-faceted cases
Case strategy; trial prep
High
Medium
Attorneys; Paralegals
Theme-based information
Q&A
Witness credibility cases
Cross-examination prep
Medium
High
Attorneys
Context of statements
Chronological
Timeline-critical cases
Establishing sequence of events
Medium
High
All
Event timeline
Highlight and extract
All
Quick reference; key points
Low to Medium
High
Senior Attorneys
Critical statements
Comparative
Multi-witness cases
Consistency check
High
Low
Attorneys; Paralegals
Discrepancies; Agreements
Annotated
Complex legal issues
Training; in-depth analysis
High
Low
Junior Associates; Paralegals
Legal implications
Visual
Jury presentations
Client / jury communication
Low to Medium
Medium
All; Clients; Jury
Visual representation of key points
Summary Grid
Multi-witness; fact-heavy cases
Organized reference
High
Medium
All
Categorized information