Mick.net Posts

Mick.net

•Created by Mick.net on 9/18/2024 in #help

Allowed to use an external proxy service and let the Deno transform the JSON data?

I want to use Deno to transform some JSON data serverless. However I'm pulling the data from the proxy Brightdata using the proxy_agent (https://deno.land/x/proxy_agent@v5.1.8). So I don't use Deno as scraper/ proxy itself, but just to transform and analyse the resulting JSON data. Is this a allowed use-case? On the Deno limitations website I see: " ❌ Scrapers ❌ Forward proxy " In my opinion my use-case is still an OK use-case for Deno Deploy, but I'm curious how the Deno team thinks about it. Part of the code:

import { serve } from "https://deno.land/std@0.192.0/http/server.ts";
import { HttpsProxyAgent } from "npm:@sam01101/node-proxy-agent";
import fetch from "npm:node-fetch";

// Proxy and authentication information
const proxy = 'XXX';
const proxyAuth = 'XXXX';

async function fetchThroughProxy(query: string) {
  const agent = new HttpsProxyAgent(proxy, {
    headers: {
      'Proxy-Authorization': `Basic ${btoa(proxyAuth)}`, // Base64 encode the proxy auth details
    },
  });

import { serve } from "https://deno.land/std@0.192.0/http/server.ts";
import { HttpsProxyAgent } from "npm:@sam01101/node-proxy-agent";
import fetch from "npm:node-fetch";

// Proxy and authentication information
const proxy = 'XXX';
const proxyAuth = 'XXXX';

async function fetchThroughProxy(query: string) {
  const agent = new HttpsProxyAgent(proxy, {
    headers: {
      'Proxy-Authorization': `Basic ${btoa(proxyAuth)}`, // Base64 encode the proxy auth details
    },
  });

1 replies