AutoItScript

+Clients
  • Content count

    197
  • Joined

  • Last visited


About AutoItScript

  • Rank
    IPB Full Member

AutoItScript's Activity

  1. AutoItScript added a comment: [RC6] 3.4.7 to RC6 Upgrade fails during "members"   

    I found some logs in upload/logs.  Attached.
    upgrader_data.cgi.txt
    latest_upgrade.cgi.txt
    2015_03_25_upgrade.cgi.txt
  2. AutoItScript added a bug in Bug Tracker   

    [RC6] 3.4.7 to RC6 Upgrade fails during "members"
    Trying a test upgrade on my test board and after upgrading the database it starts on "Members" and almost instantly I get a "failed to display page". At that time the URL is:
     
    http://xxxx/ips4clean/admin/upgrade/?controller=upgrade&key=f9289a770097e911f59d5e6cab3e9d8a&mr={"0":"1","1":"core","extra":{"lastSqlId":"0","_current":"40000","_upgradeData":"0","_upgradeStep":"1"}}&mr_error=1
     
    My 3.4.7 board is free of any hooks/addons/applications - it is massive though (1million posts / 62k members).  Are there any logs you could use?
     
    I've done a clean install of RC6 ok, so my server setup seems compatible with IPB4.
     
    Edit: I followed the method in the Product Feedback forum where I only copied uploads/downloads/screenshots/public and conf_global.php from my 3.4.7 install.
    • 3 replies
    • 64 views
  3. AutoItScript added a post in a topic: IPB4 RC6 - Loss of CDN feature from IPB3 and new Amazon S3 storage missing CDN option   

    tl;dr
    - The simple Origin Pull / image/JS/URLs option from IPB3 has been lost and it's very "hacky" to emulate in IPB4
    - The new Amazon S3 storage type is only being used for simple storage rather than CDN - it needs a URL option to work as 
    CDN. 

    Apologies if I've misunderstood the new IPB4 options, I've only just installed a test board for it and am in the middle of 
    culture shock    The feature request tracker seems to have gone too so this seems the best place to post.

    Origin Pull Feature Loss
    My usage of IPB3 and a CDN is as follows:
    - I want to serve my site from my own server, with the exception of images (themes, emoticons, photos) which I serve from 
    Amazon Cloudfront CDN. This results in very fast page loads at a tiny cost ($15 a month on average for a site with 1+ 
    million posts)
    - Cloudfront is simply set up in Origin Pull mode (similar to many other CDNs). This means when you use a url like 
    xxx.cloudfront.net/forum/uploads/image.jpg the CDN makes a request to my site if it doesn't already have a cache of the 
    file. The resulting cached file can be distributed from the CDN edge locations. I believe CloudFlare/MaxCDN/Others can also 
    be setup in the same way. They are essentially a dumb mirror. 
    - In IPB3 this setup was super easy to configure - you just change use the "images" URL. Done.
    In IPB4 it looks like the simple URL option is gone. You need to configure storage types to move content around. There is no 
    simple "Origin Pull" option where you can enter a different URL. I imagine this would be easy to add because the file 
    content stays in place - all we need is a storage type that rewrites the URL.
    You can emulate the old IPB3 config by doing this hacky method. But I worry about abusing features like this because it 
    tends to come back to bite during upgrades:
    Let say my website file system uploads folder and URL are:
    /var/www/mysite/forum/uploads
    http://www.mysite.com/forum/uploads
    You can create a new File System storage option which still points to the local IPB installation (a different path) but then use the CDN URL:
    /var/www/mysite/forum/uploads-cdn-originpull
    http://xxxxx.cloudfront.net/forum/uploads-cdn-originpull
    This storage setting can then be assigned to themes/photos/etc. In the background these files are then moved from /uploads to /uploads-cdn-originpull and the CDN url is used when they are displayed. This seems to work but of course there are now files being moved between folders which is not really required and adds a bit of risk.

    Amazon S3 Issues
    The IPS blurb in the feature map says:
     
     
    This implies that the current IPB4 usage of Amazon S3 can be configured as a CDN. The current configuration of IPS4 does not actually allow you do use the CDN feature because it hardcodes the xxxx.s3.amazonaws.com URLs for your bucket. This does not use Amazon CDN and geographic edge servers. Files are served directly from your bucket in whatever region you setup the bucket. For example, my bucket was set up in Ireland. In the current IPS4 configuration a user in Hong Kong would still request the file from servers in Ireland. So all you gain in this configuration is not storing the file on your server and a tiny speed boost from storing the images on a different URL to your main site.
    In the Amazon world, to get the CDN functionality you setup a CloudFront distribution that then targets your bucket in S3 as a Origin Pull. You then use this CloudFront URL to access your content rather than using the s3.amazonaws.com URL. The ability to specify this CDN URL is missing from from the IPB4 config.
    The simple fix is to add the option of specifying an optional URL in the Amazon S3 config (like the other storage methods). Then you will have the ability to use S3 as simple storage or as a CDN as you see fit. This doesn't rely on CloudFront either you can use other CDN providers to make use of the Amazon S3 files. As long as IPB can accept a custom URL it doesn't need to know anything about the CDN inner workings (for Origin Pull).
  4. AutoItScript added a comment: Sphinx broken from 3.4.6 to 3.4.7 (latest download of 3.4.7)   

    That fix is already included in the current 3.4.7 zip file. It's not that, in fact it may be the tweaks in that which are causing problems.
  5. AutoItScript added a bug in Bug Tracker   

    Sphinx broken from 3.4.6 to 3.4.7 (latest download of 3.4.7)
    Note: I don't imagine this will be fixed for 3.4.7 but just in case the same code has ended up in IPB4...
    There appears to have been something broken in 3.4.6. to 3.4.7 with sphinx searching. I was getting really odd search results. A handful of results when there should be 1000+ and only finding posts from years ago for a search term when there was a recent post with it. Some searches seemed fine, most were completely broken (albeit returning results rather than blank).
    Sphinx 2.0.9 (the supported version)
    I only downloaded and upgraded to 3.4.7 last week (so the latest version of 3.4.7, I'm aware that there was some sphinx patch for 3.4.7 but that appears to be in the latest download zip).
    I rebuilt the sphinx.conf, reindexed, etc but still the same.
    I copied the following files from 3.4.6 over 3.4.7 and the search starts working normally.
    admin/sources/classes/search/engines
    sphinx.php
    sql.php
    admin/applications/forums/extensions/search/engines
    sphinx.php
    sql.php
    There appear to be a handful of lines changed in these files from 3.4.6 to 3.4.7 but I've not looked in any more detail than that - I just needed to get my searching working again ASAP so I copied the whole files.
    If you find which code is to blame I'd appreciate it being posted here (or PM) so that I can patch my board. I think it's probably tricky to test because if your sphinx/test board is small you appear to get OK results. I've got a 1+ million posts so problems with sphinx/search are very easy to find.
    • 5 replies
    • 64 views
  6. AutoItScript added a post in a topic: "Protected Forum" should be "Protected Forum. You Have Access"   

    I'm on 3.3.4 - only people without access see "protected forum". Are you sure it's not a custom skin issue?
  7. AutoItScript added a post in a topic: Attachments in fast reply much needed!   


    Ha! Such an easy idea. I've just done the same :)
  8. AutoItScript added a post in a topic: PLEASE provide a change log   

    +1 It's alway nice to be able to point my users at a nice list of new or changed features after a upgrade.
  9. AutoItScript added a post in a topic: Attachments in fast reply much needed!   

    I don't have a problem with the current system. I've never had feedback that my users are unable to find how to attach. Just suggesting an easy way someone could mod their board to help users who are unable to work out how to attach from quick reply without adding any overhead :)
  10. AutoItScript added a post in a topic: Attachments in fast reply much needed!   

    Why not just add an attachment icon, a paper clip or something, into the fast reply toolbar. Make it open up the full editor.
  11. AutoItScript added a post in a topic: Recent security patch... felt left in the dark a little...   

    The how to install post was fine, but I agree with the OP. Some more context about what the patch did and a pointer to how to check if you'd already been hacked would have been preferable. The attacks reported on this forum and the rest of the internet in relation to this patch all appear to have similar symptoms.

    My server is very nicely locked locked down and I was feeling pretty smug as I applied the patch on the 27th. Then I spent hours trying to work out if I'd already been hacked...just to be sure. I had - on the 25th. But I found out that it usually manifested itself in the cache and how to check and fix this from an non-Invision forum. There is still no official "check" or recommendation aside from "install patch". It's easy enough to update the patch post to say. "From tickets we've investigated, the most common result of recent hacks are X, here are some tips for cleaning it up. If you need additional help please file a ticket for support").




    Average users shouldn't be running forums. If a user is in the ACP, seeing a warning message, browsing a forum, reading about a patch and using FTP/SFTP to upload a php file I'm pretty sure they could cope with some context and a cautionary click on the "rebuild skins" button if that was a common fix post-patch :D Again, without non-IPB member support I still wouldn't know what I was looking for and that this would be required on my site...
  12. AutoItScript added a post in a topic: Editor Feedback   

    My forum is programming language based and makes extensive use of code related functionality (hence why I'm always posting code tag bugs :smile: ) 80% of the posts on my forum are code and I need what the user types to be stored and parsed properly.


    Code Tags

    For the the RTE editor - I've finally got my head around the <pre> design decision. But as long as a user can physically type in [ code ] in the RTE and have it do something then you are just going to get bug after bug logged to the point where the bug tracker will need to scan every entry and auto-reply with the "Don't type code in RTE" template... On my test forum the only way I can think of preventing this has been to make the following modifications:

    1. Remove the bbcode tag for [ code ] so that when a user types it in RTE it clearly does nothing - no code formatting appears which is a clear indication to the user that they (and not the forum) is doing something wrong. It still works in STD mode because that is not a real bbcode it's just a signal for CKEditor for use <pre>
    2. Modify the rebuildposts functionality so that it goes through existing posts and converts old [ code ] to <pre>

    This is fine for my needs and my community, but I doubt other admins will have the stomach for that approach as it has to be done straight after the upgrade and rebuildposts is risky (it currently breaks code entirely in 3.4.1 - http://community.invisionpower.com/resources/bugs.html/_/ip-board/code-tags-from-33-are-double-spaced-in-34-r40163 ) - so even with my modifications I'm still putting off my upgrade,

    My members are used to just being able to start typing code. Clicking a button and selecting a language type, and then typing it in a dialog is a bit annoying. Is it possible to add a shortcut key that at least starts the code block in the editor.


    Custom BBCode

    Not directly editor related, but relevant to anyone fighting with custom bbcode. Take a look at an example post on my forum: http://www.autoitscript.com/forum/topic/146866-best-coding-practices-in-autoit/

    I use a custom bbcode of [ autoit ] to use geshi to syntax highlight my language. Default code tags incorrectly highlight it so I gave up on those years ago. I wish there was a prettyprint force plain option, auto detect is awful. If I post a text file why would I want something to guess and randomly highlight it?

    In 3.3.x I simply added a custom bbcode, took the input, ran it though my geshi class, and passed back the output. It works great. In 3.4 this is completely broken. The input to the bbcode plugin has been so preprocessed to such an extent that it is missing input that that user typed, or it has been mangled. I spent a few weeks writing functions that allow the custom bbcode functions to work around these issues until it became clear that even when my function outputted html in the right format that there were just too many places in the other source files that had this kind of logic:

    1. Do some stripping, purifiying, XSS check, n to BR conversion, < p > wrap, < p > dewrap, etc.
    2. Unless it's a <pre> tag, in which case do something else or nothing at all,

    Once I got that far and read Matt's comments about wanting to work natively with <pre> I decided that custom bbcodes are no longer usable for what I need and it was too much effort fighting the parsing. I then starting trying to add my language to work as a CKeditor <pre> style.
  13. AutoItScript added a post in a topic: Anti-cache hash should change on edit or re-cache.   



    Did you get a fix for this? I've got the same issue.
  14. AutoItScript added a post in a topic: Unable to open IPS forums from work   

    Thanks. I've changed the function and see if the noise of whining users lessens :)
  15. AutoItScript added a post in a topic: Unable to open IPS forums from work   


    What was the fix?