Someone Special's questions

I am having errors while running duplicity in macOS (crontab)

The duplicity command is as follows (works in Command-line)

/usr/local/bin/duplicity /Users/myname/go file:///Volumes/EVO840\ -\ IMPORTANT/DuplicityGo/ --exclude '**/bin/***' --exclude '**/pkg'

When using crontab -e (with and without sudo),

* * * * * /Users/myname/bashscripts/duplicity.sh > /Users/myname/bashscripts/duplicity.log 2>&1

it returns following error

Traceback (innermost last):
  File "/usr/local/bin/duplicity", line 87, in <module>
    with_tempdir(main)
  File "/usr/local/bin/duplicity", line 72, in with_tempdir
    tempdir.default().cleanup()
  File "/usr/local/Cellar/duplicity/0.8.23/libexec/lib/python3.9/site-packages/duplicity/tempdir.py", line 69, in default
    _defaultInstance = TemporaryDirectory(temproot=config.temproot)
  File "/usr/local/Cellar/duplicity/0.8.23/libexec/lib/python3.9/site-packages/duplicity/tempdir.py", line 155, in __init__
    temproot = subprocess.check_output([u'getconf', u'DARWIN_USER_TEMP_DIR'])
  File "/usr/local/Cellar/[email protected]/3.9.13_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/subprocess.py", line 424, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/local/Cellar/[email protected]/3.9.13_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/subprocess.py", line 505, in run
    with Popen(*popenargs, **kwargs) as process:
  File "/usr/local/Cellar/[email protected]/3.9.13_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/subprocess.py", line 951, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/usr/local/Cellar/[email protected]/3.9.13_1/Frameworks/Python.framework/Versions/3.9/lib/python3.9/subprocess.py", line 1821, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
 FileNotFoundError: [Errno 2] No such file or directory: 'getconf'

Attempt of list Nr. 1 failed. PermissionError: Operation not permitted
Attempt of list Nr. 3 failed. PermissionError: Operation not permitted
Attempt of list Nr. 4 failed. PermissionError: Operation not permitted

I have a nodeJS application with reverse proxy.

This is my desire settings

1. Nginx always maintain a cache copy (source of truth)

2. Client should always revalidate.

3. My application will be able to purge cache with Cache-Purge: true header

My Cache-Control for my served data is

s-maxage=86400 must-revalidate

And my nginx settings for location block is as follow

location / {

    # Start Cache Settings
    # https://www.nginx.com/blog/nginx-caching-guide/

    proxy_cache_key $request_uri;
    proxy_cache my_cache;
    proxy_cache_revalidate on;
    proxy_cache_use_stale error timeout updating http_500 http_502 http_503 http_504;
    proxy_cache_background_update on;
    proxy_cache_lock on;
    add_header X-Cache-Status $upstream_cache_status;
    proxy_cache_bypass $http_cache_purge;
    
    
    # End Cache Settings
    proxy_set_header X-Forwarded-For $remote_addr;
    proxy_set_header Host $http_host;
    proxy_pass: $upstream
}

My information are cached, however, when I issue the curl to purge the cache

curl http://example.com/abc -H 'Cache-Purge: true' -I

the cache key is cleared, and I am able to see the fresh data when I issue

curl http://example.com/abc

However (the issue...)

When my front-end application (sending GET request with javascript fetch()), it's still returning the old cache (I try setting Cache-Control: no-cache as well.).

While curl request is serving the new cache (after purge).

When I got to my nginx cache folder, I saw 2 different copies of cache, one served to my curl request, one served to my javascript request.

IF I were to request the API directly in the browser, it's also serving the fresh content (curl request).

How can I achieve consistent cache results?

EDIT: nginx could be caching base on my origin headers, how can I ignore that?

I have previously installed mod pagespeed on my apache2 but because it doesn't feels like the way I want it.. website ends up slower than I want it to be, I end up remove it using apt-get autoremove.

However, I notice that the following are still being added to the end of each and every of my webpages.

I have restarted apache2 and restarted server and it's still the same. How do I remove it because now that mod page speed is no longer installed, the script below returns 404 error.

<script type="text/javascript" src="/pagespeed_static/js_defer.tRzI7EHUpg.js">