Mick.net
Mick.net4mo ago

Allowed to use an external proxy service and let the Deno transform the JSON data?

I want to use Deno to transform some JSON data serverless. However I'm pulling the data from the proxy Brightdata using the proxy_agent (https://deno.land/x/proxy_agent@v5.1.8). So I don't use Deno as scraper/ proxy itself, but just to transform and analyse the resulting JSON data. Is this a allowed use-case? On the Deno limitations website I see: " ❌ Scrapers ❌ Forward proxy " In my opinion my use-case is still an OK use-case for Deno Deploy, but I'm curious how the Deno team thinks about it. Part of the code:
import { serve } from "https://deno.land/std@0.192.0/http/server.ts";
import { HttpsProxyAgent } from "npm:@sam01101/node-proxy-agent";
import fetch from "npm:node-fetch";

// Proxy and authentication information
const proxy = 'XXX';
const proxyAuth = 'XXXX';

async function fetchThroughProxy(query: string) {
const agent = new HttpsProxyAgent(proxy, {
headers: {
'Proxy-Authorization': `Basic ${btoa(proxyAuth)}`, // Base64 encode the proxy auth details
},
});
import { serve } from "https://deno.land/std@0.192.0/http/server.ts";
import { HttpsProxyAgent } from "npm:@sam01101/node-proxy-agent";
import fetch from "npm:node-fetch";

// Proxy and authentication information
const proxy = 'XXX';
const proxyAuth = 'XXXX';

async function fetchThroughProxy(query: string) {
const agent = new HttpsProxyAgent(proxy, {
headers: {
'Proxy-Authorization': `Basic ${btoa(proxyAuth)}`, // Base64 encode the proxy auth details
},
});
0 Replies
No replies yetBe the first to reply to this messageJoin

Did you find this page helpful?