MP emails on Screen Scraping Issues:

infestationwatchSoftware and s/w Development

Oct 28, 2013 (3 years and 11 months ago)

279 views




MP emails

on Screen Scraping Issues
:




The only data we are currently scraping is Congestion Shadow Prices.


As far as I know,
the only place this is available is on the
[ERCOT]
website.





one of the things that is only available through TML is the “Find

Transaction” life cycle
information.


It would be great if this information was available through the APIs.




Under
www.ercot.com



Grid Information


Current Load or
http://mospublic.ercot.com/ercot/jsp/frequency_control.jsp

are the limits under
the
Monitored CSC/CRE Flow table at the bottom of the page available in an extract that
ERCOT provides?


If available how often is this extract available and how often is it
updated?


In addition how often is the website updated?




Under
www.ercot.com



Grid Information


Emergency Notification or
http://mospublic.ercot.com/ercot/jsp/emergency_notification
s.jsp

are the messages or
emergency notifications available in an extract that ERCOT provides?


If available how
often is this extract available and how often is it updated?


In addition how often is the
website updated?






refreshing of the MosPublic

Re
al Time Load information, MCPE, and Ancillary Services
information.


This data is accessed via the Real Time selection on the ercot.com website
which then directs the user to MosPublic web pages.


We display this information in real
time on our trading roo
m floor where it is used by our Supply department throughout the
day during their wholesale operations.


Obviously, they need up to the minute information
for their operations


something not available currently via the TML or any other API that
Ercot has
as of yet informed me of (I’ve asked).


mospublic

I could print each page and hilite everything I need.


If ERCOT can provide this info
via API I can see what it would take to use it.

Didn’t we go through all of this before?

Market Transparency.



Back i
n 2003, PR
-
20126


PR
-
20128.

http://mospublic.ercot.com/ercot/jsp/ca_load_forecast.jsp

http://mospublic.ercot.com/ercot/jsp/commercially_significant_constraints.jsp

http://mospublic.ercot.com/ercot/jsp/csc_cre.jsp

http://mospublic.ercot.com/ercot/jsp/ca_lo
ad_hist.jsp

http://mospublic.ercot.com/ercot/jsp/frequency_control.jsp

http://mospublic.ercot.com/ercot/jsp/sufficiency_report.jsp

http://mospublic.ercot.com/ercot/jsp/scheduled_zonal_generation.jsp


resource specific bid limits

https://tml.ercot.com/tibco/market_activity?catid=rsbl


For the following we hit the site everyday and check a list of files.


If there is a new or modified file
we get it and process it. Lower priority for an API.


mcpe revisions

http://www.ercot.com/mktinfo/services/bal/index.html


agg bid curves

http://www.ercot.com/mktinfo/agg_bid/2005/11/index.htm
l


non spin deployments

http://www.ercot.com/mktinfo/services/Non
-
Spin_Deployments.html


congestion summar
y

http://www.ercot.com/gridinfo/congestion/summary/index.html