WebPilot URL Analysis and Summarization

Useful for analyzing and summarizing URLs using AI and storing the results for further use or analysis.

The WebPilot URL Analysis Flow is designed to automatically analyze URLs using AI and store the results for further use or analysis. This flow leverages the WebPilot API to provide insights based on the content of the specified URLs.

This template is versatile and useful in various applications such as go-to-market strategies, content analysis, service delivery, and more.

You can find this template in the Services Catalog under these categories:

• AI, Contextual Basics, CRM, Enrichment, and Marketing Automation

What's Included

• 1 Flow

• 1 Object Type

• 1 Connection

What You'll Need

• A WebPilot API Key

Ideas for Using URL Analysis

Competitive Analysis for Marketing Strategies

Use URL analysis to examine competitor websites, blogs, or landing pages. The insights can help you understand their positioning, content strategy, and key messaging, enabling you to refine your own marketing efforts.

Content Quality Assessment

Analyze URLs to assess the quality and relevance of content on your website or others. This can be especially useful for maintaining high standards in content creation, SEO optimization, and ensuring alignment with your audience’s expectations.

Automated Research for Product Development

Leverage URL analysis to gather information from multiple sources quickly. Whether it’s product reviews, industry news, or academic articles, this can speed up the research process and provide valuable insights for product development teams.

Brand Monitoring

Monitor URLs of blogs, news outlets, or social media profiles to track mentions of your brand. This can help in understanding brand perception, managing reputation, and responding to potential PR issues proactively.

Competitor Product Comparison

Use URL analysis to compare your products with competitors’ offerings by analyzing product pages. This can help in identifying strengths, weaknesses, and unique selling points, providing data-driven insights for your sales and product teams.

Flow Overview

1. Flow Start: The flow begins by receiving a prompt (a question or text) and a URL to analyze.

2. Send Prompt to API: The prompt and URL are sent to the WebPilot API for analysis. The API processes the information and returns an AI-generated response.

3. Process the API Response: The AI response is processed to extract the relevant insights and data.

4. Create a Record: The processed data is formatted and saved as a record in the system for future reference or analysis.

5. Error Handling: The flow includes mechanisms to catch and log any errors that occur. If an error happens, it will be logged in the Flow Editor Debug pane or in Agent Logs if this flow is paired with an Agent.

6. Flow End: The flow completes its process after successfully creating a record or handling an error.

WebPilot URL Analysis & Summarization Flow

WebPilot URL Analysis Flow Details

1. Inject Node

Node: Test Prompt

Purpose: This node provides the initial data (prompt and URL) for testing within the Flow Editor by clicking the button on the node itself. You can edit the values to test various inputs.

Explanation:

• The node injects a sample prompt and URL into the flow. These values are manually set for testing purposes.

2. Prepare Prompt Function

Node: Prepare Prompt

Purpose: This function prepares the data to be sent to the WebPilot API by formatting the input into the required structure.

Explanation:

// Prepare the payload for WebPilot API request
msg.payload = {
    model: "wp-watt-3.52-16k",
    content: `${msg.payload.prompt} ${msg.payload.url}`
};

// Return the modified msg object
return msg;

• msg.payload.prompt: Contains the text prompt that needs to be analyzed.

• msg.payload.url: Holds the URL that will be analyzed by the AI.

• The modified msg.payload is returned for further processing.

3. API Interaction

Node: Prompt WebPilot API

Purpose: Sends the formatted prompt and URL to the WebPilot API and retrieves the analysis response.

Explanation:

• The HTTP POST request is made using the data prepared by the previous node (msg.payload).

• The API’s response, containing the analysis results, is stored in msg.payload.response.

4. Prepare Record Data Function

Node: Prepare Record Data

Purpose: This function formats the API response and prepares it to be saved as a record in the system.

Explanation:

// Prepare data for Create Object node and assign to msg.payload
let body = {
    prompt: msg.event.prompt,
    url: msg.event.url,
    aiResponse: msg.payload.response.content
}

// The Create Object node will use the content of msg.payload to create a new record
msg.payload = body;

return msg;

• msg.event.prompt and msg.event.url: Capture the original prompt and URL from the event that triggered this flow.

• msg.payload.response.content: Extracts the analysis result from the API response.

5. Record Creation

Node: Create AI Response Record

Purpose: This node creates a new record in the system using the formatted data from the previous node.

Explanation:

• The node uses the prepared msg.payload to create a new record, storing the original prompt, the URL, and the AI’s response.

6. Error Handling

Nodes:

• Catch

• Error Catch Log

Purpose: This part of the flow catches any errors that occur during the process and logs them.

Explanation:

• The catch node captures any errors in the flow.

• The log-tap node logs these errors to the Flow Editor Debug side panel and your Tenant Logs.

Summary of Flow

• Flow Start: A sample prompt and URL are injected.

• Data Preparation: The prompt and URL are formatted for the API request.

• API Interaction: The formatted data is sent to WebPilot, and the response is received.

• Record Creation: The API’s response is formatted and stored as a record.

• Error Handling: Any errors during the flow are caught and logged.

These JavaScript snippets ensure that the flow runs smoothly from start to finish, automating the analysis and recording of URL insights using AI.